Use a sanding plane on a roller stick or get a big hand sander and do it that way , feeling for little bumps

Wear a mask and goggles

I wouldn't bother removing the paste , it's a good key for the plaster to stick to