Walking into the town from the train station, we saw the National Palace perched on the hilltop