Now, a panel of federal judges has permitted construction on the massive project with a few stipulations.