There probably was a few more locals attending back when the demographics were different, but the crowds were twice the size regularly back then also.
They didn't all come from Grange and Riverside (nor likely Butetown, nor Tiger bay)
NP is walkable from half of Cardiff really .. Well .. sort of , if you like walking ;)