We demonstrate that filaments generated by ultrashort laser pulses can induce a remarkably large birefringence in Argon over its whole length, resulting in an ultrafast “half-wave plate” for a copropagating probe beam. This birefringence originates from the difference between the nonlinear refractive indices induced by the filament on the axes parallel and orthogonal to its polarization. An angle of 45° between the filament and the probe polarizations allows the realization of ultrafast Kerr-gates, with a switching time ultimately limited by the duration of the filamenting pulse.