It's a charming destination with Viking heritage, cosy eateries and independent retailers - and even when it rains, it's still lovely