The shirtless sex offender, who previously assaulted a girl on a train, pestered her grandchildren as they played outside her home