An international court has rejected Rwanda's demand for Britain to pay over £100 million from a scrapped migrant deportation deal.