Visuo-motor adaptation with optical prisms that displace the visual scene (prism adaptation, PA) has been widely used to study visuo-motor plasticity in healthy individuals and to decrease the lateralized bias of brain-damaged patients suffering from spatial neglect. Several factors may influence PA aftereffects, such as the degree of optical deviation (generally measured in dioptres of wedge prisms) or the direction of the prismatic shift (leftward vs. rightward). However, the mechanisms through which aftereffects of adaptation in healthy individuals and in neglect affect performance in tasks probing spatial cognition remain controversial. For example, some studies have reported positive effects of PA on auditory neglect, while other studies failed to obtain any changes of performance even in the visual modality. We here tested a new adaptation method in virtual reality to evaluate how sensory parameters influence PA aftereffects. Visual vs. auditory-verbal feedback of optical deviations were contrasted to assess whether rightward deviations influence manual and perceptual judgments in healthy individuals. Our results revealed that altered visual, but not altered auditory-verbal feedback induces aftereffects following adaptation to virtual prisms after 30-degrees of deviation. These findings refine current models of the mechanisms underlying the cognitive effects of virtual PA in emphasizing the importance of visual vs. auditory-verbal feedback during the adaptation phase on visuospatial judgments. Our study also specifies parameters which influence virtual PA and its aftereffect, such as the sensory modality used for the feedback.