The singer and songwriter loves nothing more than making the most of the capital’s vintage markets and cosy pubs