Violent Mergers Might Be Robbing Galaxies of Their Star-Birthing Material