Take your dog into the vet to receive an up-to-date rabies shot. This should be done every two years.
Receive a rabies certificate from the vet. If your dog is already up-to-date on the shots but you can't find the rabies certificate, contact your vet. He will be able to provide you with new paperwork.
Take the rabies certificate with you on the trip. While crossing the border with your dog you will be asked for the rabies certificate to make sure the dog's shots are current.
Present the information to the border officer. Once the document has been inspected you will be allowed to cross into Canada.