A picture-perfect town brimming with independent shops and home to major film productions was previously named as 'one of the best places to live'