The poorest in society rely most on cash, esp to help tide them over. It's an absolutely critical piece of social infrastructure.
Tax avoidance is of course an issue, but the big wins there are in the huge multinational companies keeping money off shore..not trying to dismantle a cash system that keeps money flowing and is vital to those most vulnerable in society.