Speculation has increased over whether the justice, who joined the court in 2006, will retire following a book about his career.