You define racism as prejudice based on skin colour but then tell me if it was based on his skin colour its just name calling
Calling names is not the same as discriminating. That's the salient point that society seems to have lost sight of. I'm certainly not saying it's right, but calling names and even making monkey chants or throwing bananas isn't "discriminatory". It's unacceptable, crass and ignorant, but that's not the type of action that prevents people from achieving things and enjoying equal privilege to other.
Nowadays we see footballers storming off the pitch in tears because someone has made a 'racist' remark. Well I'm sorry, but man the **** up! Every other person on the pitch has to tolerate every possible insult, having their wives' integrity questioned, their parentage, hair colour... But as soon as someone mentions skin colour, they burst into tears?? It's ridiculous. This isn't some sort of repression, it's sticks and stones!
Sadly, the only real 'racism' that's at play in these sort of situations is that people with a different skin colour have an unvanquishable weapon in that they can accuse people of racism, whereas if say a ginger-haired person, for example, suffers abuse about their appearance, they have no recourse whatsoever.