Spanning media, academic and business circles, people have stepped down over their relationship with the late sex offender.