Drivers in England are at risk from "enforcement agents" visiting them - with 178,554 facing bailiffs.