An appeal has been lodged after the council refused permission for a retrospective planning application.