Andrew Mountbatten-Windsor has been urged to get all his belongings removed from Royal Lodge as soon as possible.