In regard to the specific case of Vancouver....
#1- It's Canada, not US. The requirements that the WC makes are not specific to US. Vancouver and BC apparently feel that those requirements are too loosely defined to make it worth the risk. They mentioned the visa situation, and the open ended claim to BC Place.
#2- If it were only a matter of expedited visas for players and staffing, I don't know why that would be a problem. The fact that visa is mentioned in BC's announcement suggests that FIFA was not limiting the suspension of normal rules, and wanted a blanket open door of some kind.
Conclusion on this particular case: No need to accuse anyone of bigotry on the basis of BC bowing out of hosting.
On Minneapolis - Same thing. The city backed off because the requirements were too broad. There is serious money involved, because it's an artificial surface, and they would need grass, and it seems FIFA is very pedantic in its rules. City takes all the risk, and there isn't much that the city gets back, other than prestige and any tourism that goes with it (which is likely to be very small in Minneapolis). Again, no racism involved.
Chicago - see Minneapolis.
As for FIFA and its association with Qatar.... These are simply my opinions, and I'm willing to be corrected....
But,
It was well known that Qatar had this foreign worker system.
Therefore, when FIFA awarded the bid, if they thought about it, they would know it would be foreign workers building the stadia.
Since those workers have been abused for a long time, that makes FIFA a little bit culpable.
However, not so much culpable about that, because we all know that Qatar didn't win on merit. FIFA voted according to their own $$ pleasure and the promises of perks of various kinds. That's what FIFA is all about.
Qatar bid for prestige. There is not going to be enough tourist money to make up for what it costs them to build. So, they were willing to pay whatever for the sake of prestige.
That makes FIFA very similar to IOC.
And, it gives exactly the reason needed, if they want one, to put 2026 in Morocco.
Basically, FIFA is corrupt on multiple levels. And, one doesn't need to be racist to say so.