Brain functions do not arise from isolated brain regions, but from interactions in widespread networks necessary for both normal and pathological conditions. These Intrinsic Connectivity Networks (ICNs) support cognitive processes such as language, memory, or executive functions, but can be disrupted by epileptic activity. Simultaneous EEG-fMRI can help explore the hemodynamic changes associated with focal or generalized epileptic discharges, thus providing information about both transient and non-transient impairment of cognitive networks related to spatio-temporal overlap with epileptic activity. In the following review, we discuss the importance of interictal discharges and their impact on cognition in different epilepsy syndromes. We explore the cognitive impact of interictal activity in both animal models and human connectivity networks in order to confirm that this effect could have a possible clinical impact for prescribing medication and characterizing post-surgical outcome. Future work is needed to further investigate electrophysiological changes, such as amplitude/latency of single evoked responses or spontaneous epileptic activity in either scalp or intracranial EEG and determine its relative change in hemodynamic response with subsequent network modifications.