A royal expert says the former Duke of York believes people have unfairly turned on him despite his arrest last month