Basically, was the bath named after the city or was the city named after the bath?
The city was named after the Roman baths. The Roman name for the city was Aquae Sulis (Waters of Sul). The Anglo Saxons later called it Baưum, which is roughly 'At the Baths'. The Anglo-Saxon name was eventually shortened to simply Bath.