Swalwell denies the allegations, calling them politically motivated, as pressure mounts on him to drop out of the race for California governor