Trithorax-group proteins and their mammalian homologs, including those in BAF (mSWI/SNF) complexes, are known to oppose the activity of Polycomb repressive complexes (PRCs). This opposition underlies the tumor-suppressive role of BAF subunits and is expected to contribute to neurodevelopmental disorders. However, the mechanisms underlying opposition to Polycomb silencing are poorly understood. Here we report that recurrent disease-associated mutations in BAF subunits induce genome-wide increases in PRC deposition and activity. We show that point mutations in SMARCA4 (also known as BRG1) mapping to the ATPase domain cause loss of direct binding between BAF and PRC1 that occurs independently of chromatin. Release of this direct interaction is ATP dependent, consistent with a transient eviction mechanism. Using a new chemical-induced proximity assay, we find that BAF directly evicts Polycomb factors within minutes of its occupancy, thereby establishing a new mechanism for the widespread BAF-PRC opposition underlying development and disease.