Dozens of construction trucks heading for a renowned golf course have residents fearing their old houses will be “shaken to bits”.