A man who sexually abused a vulnerable woman in a swimming pool steam room has been jailed for six years.