Lyon was particularly rough for me the two times I've been there. Lots of homeless people and a lot of large tower block areas that the poor are channeled into.

Middlesbrough is probably the roughest UK city I've stayed in as a whole. The bigger cities like London/Manchester probably have rougher areas but these are counteracted with nice areas. I saw no redeeming features in Middlesbrough.