Chiral amines with a pyrrolidine framework catalyze the enantioselective conjugate addition of a broad range of aldehydes to various vinyl sulfones and vinyl phosphonates in high yields and with enantioselectivities up to >99% ee. This novel process provides synthetically useful chiral γ-gem-sulfonyl or phosphonyl aldehydes which can be widely functionalized with retention of the enantiomeric excess. Mechanistic insights including DFT calculations are explored in detail.