The Government has backed down on a controversial proposal to amend the Fisheries Act to remove minimum size limits for commercial fishers.