Fans, players and referees have all had their visas revoked or denied by the USA ahead of the start of the World Cup.