A man who claims to have been sexually abused as a teen by an ex-MP has said the event was hard to process for his young mind.