The town was named Best Place to Live in the country and won the Tidy Towns Competition three times, yet remains relatively quiet when it comes to tourists