Correct it's only racist when those said black people choose it's racist, for example when someone white says it, if it's good enough to be racist when an opposition player says it then it's racist when they say it.
And if that means the match is abandoned then who's to blame?, the referee for...