We show that in graphene epitaxially grown on SiC the Drude absorption is transformed into a strong terahertz plasmonic peak due to natural nanoscale inhomogeneities, such as substrate terraces and wrinkles. The excitation of the plasmon modifies dramatically the magneto-optical response and in particular the Faraday rotation. This makes graphene a unique playground for plasmon-controlled magneto-optical phenomena thanks to a cyclotron mass 2 orders of magnitude smaller than in conventional plasmonic materials such as noble metals.