Lured by a beautiful waterfront, subversive music venues and quirky independent shops, Claire Boobyer discovered a Suffolk town waiting to be rediscovered