I agree. It's not really possible to clearly define who is "bigger" but Everton do just about trump Leeds, Newcastle and Man City (perhaps not anymore but certainly when City last went down) for me. Not least as they are wrapped up in the whole Liverpool being a footballing city thing.
I actually quite like Everton, but I would love to see them go down just to shake it all up a bit and would be good for the championsip for someone to challenge Norwich's traditional biennial dominance..