Does the lithosphere contains both land masses and oceans?

No, the lithosphere only contains land masses. The lithosphere is the rigid outermost layer of the Earth, and it consists of the crust and the upper mantle. The oceans are part of the hydrosphere, which is the layer of the Earth that contains all the water.