The First Minister has decided not to appear with all the other Scottish party leaders on Question Time this week.