The fact people with criminal convictions were given licences is "regretted and should not have happened", police say.