Whether an object captures attention depends on the interplay between its saliency and current behavioral predispositions of the observer. Neuroimaging work has implied a ventral attention network, comprising the temporoparietal junction (TPJ), lateral prefrontal cortex (lPFC) and the insula, in attentional orienting toward salient events. Activity of the TPJ is driven by novel and unexpected objects, while the lateral prefrontal cortex is involved in stimulus-driven as well as goal-directed processing. The insula in turn, is part of a saliency network, which has been implicated in detecting biologically salient signals. These roles predict that damage to the TPJ, lPFC, or insula should affect performance in tasks measuring the capture of attention by salient and behaviorally relevant events. Here, we show that patients with lesions to the right TPJ have a characteristic increase of attentional capture by relevant distracters. In contrast, damage to the lPFC or insular cortex only increases reaction times, irrespective of the task-relevant properties of distracters. These findings show that acquired damage to the TPJ pathologically amplifies the capture of attention by task-relevant information, and thus indicate that the TPJ has a decisive role in goal-directed orienting.