Well, its clearly what you think they are because that is the easiest way to dismiss them. I wonder whether in fact you have no idea about them or the reasons, right or wrong for the way that they voted.
Personally I agree with you, that as a nation we should have voted to remain but I live in Rotherham and to say immigration has had no detrimental effects and that no one has any legitimate concerns about the issues it raises and the challenges it causes, that's denial.
Your blanket refusal to address the concerns and to castigate those who raise them as racists or xenophobes is why the political establishment can't respond to the challenge. I think people who hold your view are more dangerous than the racists because there will always be stupid racists and as long as we can argue the issues we can resolve them and move on but you and people like you can't argue the issues. You have already decided there aren't any and you are loosing on every front and in every country in the EU.
Carry on and see where it leads.