Prdm1 mutant mice are one of the rare mutant strains that do not develop whisker hair follicles while still displaying a pelage. Here, we show that Prdm1 is expressed at the earliest stage of whisker development in clusters of mesenchymal cells before placode formation. Its conditional knockout in the murine soma leads to the loss of expression of Bmp2, Shh, Bmp4, Krt17, Edar, and Gli1, though leaving the β-catenin-driven first dermal signal intact. Furthermore, we show that Prdm1 expressing cells not only act as a signaling center but also as a multipotent progenitor population contributing to the several lineages of the adult whisker. We confirm by genetic ablation experiments that the absence of macro vibrissae reverberates on the organization of nerve wiring in the mystacial pads and leads to the reorganization of the barrel cortex. We demonstrate that Lef1 acts upstream of Prdm1 and identify a primate-specific deletion of a Lef1 enhancer named Leaf. This loss may have been significant in the evolutionary process, leading to the progressive defunctionalization and disappearance of vibrissae in primates.