This quirky village boasts England's tiniest Grade II listed building and residents who love to see the stars at night