Yeah but the definition of white changes every decade.
In the early 1900s, they didn't even consider Italian immigrants to America white but these days, Italian Americans (some even as dark as a Mestizo) are seen as white as a Scandinavian.
Plus, it even depends on how you define "white" countries. When I went to Europe, I noticed some Spaniard and Italian locals would easily be seen as "brown" in America or ethnic, they did not look that white.
Then add to that the fact that white guys are the ones going abroad and marrying Asian women and Latinas en masse, they go interracial at far higher rates in the US than white women.
IMO, whites really have no one to blame but themselves. It's a Domino Effect, first you start considering swarthy Southern Euros white and a 100 years from now, George Lopez is gonna be considered white.