Surely the obvious solution is to just check the brown people?

With extra vigilance for ones with beards.