We compute the gravity waves induced by anisotropic stresses of stochastic primordial magnetic fields. The nucleosynthesis bound on gravity waves is then used to derive a limit on the magnetic field amplitude as function of the spectral index. The obtained limits are extraordinarily strong: If the primordial magnetic field is produced by a causal process, leading to a spectral index