The state of an informal green space in Oldham is accused of attracting anti-social behaviour to the area.