Rep. Kevin Kiley of California said Monday he was immediately leaving the Republican Party to become an independent.