Hair is there for a reason - to absorb sweat.
If you shave to the skin you'll have nothing to absorb sweat so will end up with a sweaty groin and an itchy sweat rash.

Disclaimer - a 'mate' told me this