The port city has a naval history stretching back hundreds of years, but defence cuts have left it in economic limbo.