Police believe the fisherman was not wearing a lifejacket when he slipped into the water at the popular fishing spot on the NSW South Coast.