In a letter sent last week, nearly 20 labor and advocacy groups said the developer could squander an opportunity if there is not strong leadership at the top.