Microtubules play crucial roles in cellular architecture, intracellular transport, and mitosis. The availability of free tubulin subunits affects polymerization dynamics and microtubule function. When cells sense excess free tubulin, they trigger degradation of the encoding mRNAs, which requires recognition of the nascent polypeptide by the tubulin-specific ribosome-binding factor TTC5. How TTC5 initiates the decay of tubulin mRNAs is unknown. Here, our biochemical and structural analysis reveals that TTC5 recruits the poorly studied protein SCAPER to the ribosome. SCAPER, in turn, engages the CCR4-NOT deadenylase complex through its CNOT11 subunit to trigger tubulin mRNA decay. SCAPER mutants that cause intellectual disability and retinitis pigmentosa in humans are impaired in CCR4-NOT recruitment, tubulin mRNA degradation, and microtubule-dependent chromosome segregation. Our findings demonstrate how recognition of a nascent polypeptide on the ribosome is physically linked to mRNA decay factors via a relay of protein-protein interactions, providing a paradigm for specificity in cytoplasmic gene regulation.