May, June and September: warm enough for outdoor exploring, minimal rain, and the tourist tide hasn't built up.
April–May and September–October: reliable weather, hotel rates drop 15–25%, and you'll have the Römerthermen nearly to yourself.
Go in June for the best blend of good weather, open sights, and low prices.