That's called passion or love for your club though surely.
People have varying levels of passion and love for the club.
If this is high then yes it will affect them to a great degree. That's just logical. If you don't care if the club slips down the league too much then no you won't be that arsed.
This club is a big part of some people's lives. Currently it isn't very positive and relegation would compound that.