The "h" is silent so don't pronounce it. Say "ahm-bray" quickly.
If you want to say "man" as a form of address like, "Hey man, I like your car," you can still use "hombre." However, you may want to use a less formal word like "amigo," which means friend. In parts of Latin America, "mano" is acceptable. A casual speaker in Argentina may use "che" and a speaker in Spain may say "tio."
Hombre is also used in English as a slang for man.