There are just 15 breeding pairs returning to nest at Manly each year, and the population is stubbornly refusing to grow.