Dissociating the neural correlates of consciousness and task relevance in face perception using simultaneous EEG-fMRI

Dellert T, Müller-Bardorff M, Schlossmacher I, Pitts M, Hofmann D, Bruchmann M, Straube T

Abstract

Current theories of visual consciousness disagree about whether it emerges during early stages of processing in sensory brain regions or later when a widespread frontoparietal network becomes involved. Moreover, disentangling conscious perception from task-related postperceptual processes (e.g., report) and integrating results across different neuroscientific methods remain ongoing challenges. The present study addressed these problems using simultaneous EEG-fMRI and a specific inattentional blindness paradigm with three physically identical phases in female and male human participants. In phase 1, participants performed a distractor task during which line drawings of faces and control stimuli were presented centrally. While some participants spontaneously noticed the faces in phase 1, others remained inattentionally blind. In phase 2, all participants were made aware of the task-irrelevant faces but continued the distractor task. In phase 3, the faces became task-relevant. Bayesian analysis of brain responses demonstrated that conscious face perception was most strongly associated with activation in fusiform gyrus (fMRI) as well as the N170 and visual awareness negativity (EEG). Smaller awareness effects were revealed in the occipital and prefrontal cortex (fMRI). Task-relevant face processing, on the other hand, led to strong, extensive activation of occipitotemporal, frontoparietal, and attentional networks (fMRI). In EEG, it enhanced early negativities and elicited a pronounced P3b component. Overall, we provide evidence that conscious visual perception is linked with early processing in stimulus-specific sensory brain areas but may additionally involve prefrontal cortex. In contrast, the strong activation of widespread brain networks and the P3b are more likely associated with task-related processes.