A sprawling residential development built without a single permit in a Natura 2000 site has triggered a row over who let it happen