The former deputy prime minister has criticised the government’s approach to immigration in a candid speech