The phrase means our housing expectations are unrealistic fantasies. "Castles in the air" = impractical dreams lacking foundation. Smith is urging acceptance of modest, functional accommodations instead of yearning for luxury beyond means. It's a call for pragmatism over wishful thinking—grounding aspirations in what's achievable.