The Irish Thalidomide Association said 'time is not on our side' as they urge the Government to issue an apology