We perform a numerical analysis of a class of randomly perturbed Hamiltonian systems and Poisson systems. For the considered additive noise perturbation of such systems, we show the long-time behaviour of the energy and quadratic Casimirs for the exact solution. We then propose and analyse a drift-preserving splitting scheme for such problems with the following properties: exact drift preservation of energy and quadratic Casimirs, mean-square order of convergence 1, weak order of convergence 2. These properties are illustrated with numerical experiments.