Is "New Jersey" a Proper Noun?

Yes, New Jersey is a proper noun. It names a specific U.S. state and is always capitalized, like other proper nouns (people, places, organizations).