The fire service has confirmed a blaze that broke out at an old and disused sports pavilion is being treated as a suspected arson.