If you love "Phantom of The Opera" and would love a poster of it to hang in your room back in Peoria, then head to Times Square. There are many stores there that sell souvenirs from Broadway shows plus other NYC odds and ends.
Visit Empire State Building. After you've admired the view from the top, take the elevator back down to the lobby and get yourself a miniature ESB to show your friends back home. They even have miniature ESBs with miniature King Kongs straddling the top just like in the movie.
If you love old time New York, head down to South Street Seaport where you can get a taste of old New York and get some old maritime collectibles.
Wanna take home one of the "Friends" or Conan O'Brien? Then head to the NBC Studios in Rockefeller Center. There you can get a "Friends" lunch box so you can actually tell your friends you're having lunch with Jennifer Aniston!
Checkout street vendors. Almost every block in NYC has a street vendor selling some kind of NYC souvenir.