Exclusive: Critics say board members should spend less time in ‘high-end cocktail bars’ and more time ‘driving down the cost’ of the beleaguered project