The affair was just ammunition not the motivation behind the impeachment. Newt Gingrich was the one who spearheaded it, and while this was all happening, left his wife (sick with cancer) to pursue a relationship with someone he’d been having an affair with. He even had her served with papers at the hospital while she was receiving chemo treatments. He also left her penniless.