The first group of white people believed to have entered Africa are the Phoenicians from Asia Minor around 7th-8th millennium B.C.
Later white invaders included Ancient Romans who conquered what we call Tunisia today and Ancient Greeks also settled parts of Northern Africa (e g Alexandria of Egypt was found by Alexander the Great)