Trade unions have warned green jobs are being lost while workers from oil and gas industries are also declining.