Complex auditory hallucinations are often characterized by hearing voices and are then called auditory verbal hallucinations (AVHs). While AVHs have been extensively investigated in psychiatric patients suffering from schizophrenia, reports from neurological patients are rare and, in most cases, incomplete. Here, we characterize AVHs in 9 patients suffering from pharmacoresistant epilepsy by analyzing the phenomenology of AVHs and patients' neuropsychological and lesion profiles. From a cohort of 352 consecutively examined patients with epilepsy, 9 patients suffering AVHs were identified and studied by means of a semistructured interview, neuropsychological tests, and multimodal imaging, relying on a combination of functional and structural neuroimaging data and surface and intracranial EEG. We found that AVHs in patients with epilepsy were associated with prevalent language deficits and damage to posterior language areas and basal language areas in the left temporal cortex. Auditory verbal hallucinations, most of the times, consisted in hearing a single voice of the same gender and language as the patient and had specific spatial features, being, most of the times, perceived in the external space, contralateral to the lesion. We argue that the consistent location of AVHs in the contralesional external space, the prominence of associated language deficits, and the prevalence of lesions to the posterior temporal language areas characterize AVHs of neurological origin, distinguishing them from those of psychiatric origin.