Not sure about the integrity of the competition, but I would imagine it would be easy to feel aggrieved if you lost a game because of a lack of VAR that would (possibly) have changed something.
I think it boils down to consistency. If VAR itself was speedy and consistent, I don't think many would be bothered by it. The problem is arguably the game itself, where often things aren't just black and white.