Is it bad if people speak French to Brazilians?

Brazil's official language is Portuguese, and so speaking French without an understanding of Portuguese might result in Brazilians being unable to comprehend French and may frustrate both sides in a dialogue situation.