Why is it racist when a white person call a black person names and NOT racist when black?

person call a white person names. oh "because the white man started it first". Affirmative action or double standard? this is f up...