May and September: temperatures are pleasant for walking (20-25°C), crowds are thin, and hotel rates are moderate.
April and October: 15-20°C days, 10-20% cheaper accommodation, fewer visitors, and still good for archaeological sites.
Go in May or September for the best balance of decent weather and low visitor numbers.