Beating them means everything to me.
The only time the 6 points would be more important would be if it meant the difference between going up or staying up.
For some reason though, the joy of beating them doesn't come anywhere near the feeling of misery when losing to them.