April and May: dry, sunny days, crisp evenings, and fewer visitors. Also September: spring blooms, mild weather, and fewer crowds.
March and October: cheaper rooms, still decent weather, and before the peak influx. March can be rainy but discounts are good.
Go in April or May for the best combination of clear weather, mild temperatures, and thin crowds.