One of my favourite cities, down by the river Rhone there's a load of moored up boats where you can drink, great atmosphere on them too.
The cathedral is definitely worth a look inside too and there's a great riverside bar on the soane over looking the Roman church up on the hill.