"Try explaining the political situation in Brussels to a foreigner and they'll look at you like you're crazy," Bart De Wever said