Of course you should be respectful with wild animals, but
I don't think they were necessarily hassling them, if they had been the dolphins would have just swam off.
The guy complaining probably runs dolphin watching boat trips and doesn't want people just swimming out to see them without paying.