CCR4-NOT is a major effector complex in miRNA-mediated gene silencing. It is recruited to miRNA targets through interactions with tryptophan (W)-containing motifs in TNRC6/GW182 proteins and is required for both translational repression and degradation of miRNA targets. Here, we elucidate the structural basis for the repressive activity of CCR4-NOT and its interaction with TNRC6/GW182s. We show that the conserved CNOT9 subunit attaches to a domain of unknown function (DUF3819) in the CNOT1 scaffold. The resulting complex provides binding sites for TNRC6/GW182, and its crystal structure reveals tandem W-binding pockets located in CNOT9. We further show that the CNOT1 MIF4G domain interacts with the C-terminal RecA domain of DDX6, a translational repressor and decapping activator. The crystal structure of this complex demonstrates striking similarity to the eIF4G-eIF4A complex. Together, our data provide the missing physical links in a molecular pathway that connects miRNA target recognition with translational repression, deadenylation, and decapping.