There has been a surge of interest in studying truly nonequilibrium quantum many-body phenomena, motivated both by theoretical advances such as in the understanding of many-body-localization (MBL), and by experimental advances in controlling synthetic quantum systems that serve as rich playgrounds to probe these phenomena. In this thesis, we show that looking at the physical structure of quantum systems, such as the locality of Hamiltonians and the entanglement of quantum states -- concepts with a quantum informational flavor to them -- is a useful lens with which to explore nonequilibrium many-body physics. We use these ideas to study localization -- the breakdown of ergodicity in certain classes of many-body systems, and also the timescales of thermalization in periodically driven many-body systems. We also explain the recent observations in a dipolar system of the discrete time crystal phase, an exemplary nonequilibrium phase of matter, and further consider the dynamics of entanglement in many-body systems.