How distance influences connection into a server (BF4 PS3)

I was playing BF4 on PS3, on a US server. Suddenly, a guy in my squad started to talk to me really rudely, saying me I had to get off because I was on a server that is at a very high distance from my home (Colombia). I didn't understand the point, my connection was good, so I kept on playing. After some minutes of insulting me, he started to kill me (friendly fire), that became really annoying so I wrote him: "What's wrong with you?" He shouted through the mic the same thing he was shouting me before plus something like "all of you are the same", he was waiting me to respawn (to kill me, of course) and, since I didn't do that, he got tired and disconnected, after some minutes he sent me this: "You have no bussiness in that server, you're insulting everyone there so I'm reporting you".

My question is: Is that true? Am I a problem to everyone? I guess I'm not the only latin-american out there playing in US (and even European) servers, so is this a common though or just another xenophobic guy?

Thanks a lot for your answers.