French pastries, Spanish ruins and a riverfront trail give this town its charm.