Has Albany always been the capital of New York State?

No, Albany has not always been the capital of New York State. The first capital of New York State was New York City, which served as the seat of government from 1788 to 1797. In 1797, the capital was moved to Albany, where it has remained ever since.