The transition metal dichalcogenide IrTe2 displays a remarkable series of first-order phase transitions below room temperature, involving lattice displacements as large as 20% of the initial bond length. This is nowadays understood as the result of strong electron-phonon coupling leading to the formation of local multicenter dimers that arrange themselves into one-dimensional stripes. In this work, we study the out-of-equilibrium dynamics of these dimers and track the time evolution of their population following an infrared photoexcitation using free-electron lased-based time-resolved x-ray photoemission spectroscopy. First, we observe that the dissolution of dimers is driven by the transfer of energy from the electronic subsystem to the lattice subsystem, in agreement with previous studies. Second, we observe a surprisingly fast relaxation of the dimer population on the timescale of a few picoseconds. By comparing our results to published ultrafast electron diffraction and angle-resolved photoemission spectroscopy data, we reveal that the long-range order needs tens of picoseconds to recover, while the local dimer distortion recovers on a short timescale of a few picoseconds.