The continuous production of spermatozoa is a tightly regulated biological process, both at the transcriptional and post-transcriptional levels. Recently, different classes of small non-coding RNAs have emerged as important regulators of spermatogenesis. Available molecular and genetic data, although still fragmented, underscore their crucial role in regulating the fine tuning of gene expression required for testicular function. Here, we review the latest advances accomplished in this domain, spanning from the biogenesis of these small non-coding RNAs to their roles in male reproductive function.