I don't think he had a point at all. We would have been up against Manchester United, Liverpool, Arsenal, Bayern Munich, Atletico Madrid etc. and our little offering would pale by comparison. These days we would be behind Brentford, Middlesbrough and Bristol City...yuk!
Anyway, aliens on other planets may not experience colour as we do. For example, red might be experienced in the same way we hear a fart down here