No. Horses (Equus ferus caballus) were extinct in the Americas after the Pleistocene (~10,000 years ago). They were reintroduced by Spanish conquistadors in the 16th century (first arrival 1493, Caribbean; mainland 1519).
Horses spread rapidly via escape, trade, and adoption by Plains cultures (Comanche, Mapuche, etc.). In the Andes, mules (horse × donkey) became more common than horses for cargo.
So, ancient Peruvians used llamas and human labor, not horses.