Gammon isn't a race, no. It is aimed at white men on the right. Many names aimed at black people are not races either.
If people made up a name for a black section of the BLM movement that was based solely on the colour of their skin would that not be racist regardless of how small the group was or the reason for the name?