The apologists in here ... massive OOF.
I'm a white guy. I don't live on eggshells and I don't go out of my way to make sure people aren't offended. It's amazing what happens when you're just a decent human being.
I don't go out of my way to not offend people, there are plenty of people who don't like me. What I do go out of my way to do is be fiercely anti-racist.
Whether he actually said the thing about a tough guy or not, there's no excuse for making the "slippery slope" argument. Pose the argument that the incident may not have been racially motivated, sure. But evoking the slippery slope argument is a terrible take and, whether you know it or not, is highly problematic.