Agreed, There's this perception of him as a weak dithering man in the same way corbyn was portrayed, albeit on a much smaller scale.
There's also a perception of a him as a petty individual who will make decisions simply to differ from the government in Westminster and shit like this doesn't help in that regard.