The former model who launched a TV, and then later radio career admitted that he sometimes disappoints wife Tess Daly with his fashion choices