It is because he doesn't understand what a refugee is and has bought hook line and sinker the idea that illegal immigrants are usually chancers who wouldn't otherwise be deserving of asylum.
He quite frequently links almost any topic back to his 'tough upbringing', yet doesn't seem to see the irony in casting judgement on a male refugee who has likely experienced things so terrible he couldn't even imagine.