Congressmen Tony Gonzales joined Eric Swalwell in resigning from Congress on Tuesday after facing allegations of sexual misconduct.
Lonna Drewes accused Swalwell of drugging her drink before assaulting her in a hotel room.
California Democrats were already fretting about the race due to troubling polls and low name recognition
Four women have accused the congressman and ex-candidate for California governor of misconduct ranging from sexual harassment to rape, which he has denied.
Top Democratic allies intensified pressure on him to exit the gubernatorial race.
The allegations, which he denies, have upended his bid to be California's next governor.
The high-profile Democrat, a leading contender in California's governor race, firmly denies the accusations.
The Democratic congressman, a leading candidate in the race, has strongly denied the accusations saying he will fight with "facts".
The Trump administration has announced it will move the service's headquarters to Utah and restructure the agency.