Capitalizing "Museum": When Is It Required?

No, "museum" is a common noun and should be lowercase unless part of a proper name: the British Museum, the Louvre Museum. In generic use—"visit a museum"—it remains lowercase.