Neuronal Chronometry of Target Detection: Fusion of Hemodynamic and Event-Related Potential Data

Functional magnetic resonance imaging (fMRI) data provides spatially localized subcentimeter information about blood flow and oxygenation secondary to neuronal activation, but with temporal resolution on the order of seconds. Event-related potential (ERP) studies provide millimeter resolution measurements of the electric changes induced by neuronal activity, but spatial information is not well localized and suffers from an ill-posed inverse problem since there are much fewer sensors than solutions. Combining or fusing these two techniques thus has the potential to provide simultaneous higher temporal and high spatial resolution. Localization of the brain's response to infrequent, task-relevant target 'oddball' stimuli in humans has remained challenging due to the lack of a single imaging technique with good spatial and temporal resolution. Here we use independent component analysis to fuse ERP and fMRI modalities to identify, for the first time in humans, the dynamics of the auditory oddball response with high spatiotemporal resolution across the entire brain. The results illuminate a new era of brain research utilizing the precise temporal information in ERPs and the high spatial resolution of fMRI

• Publication year

  2005

• Venue

  IEEE Workshop on Machine Learning for Signal Processing

• Publication date

  2005-11-21

• Fields of study

  Medicine, Computer Science, Psychology

• Identifiers
  DOI 10.1109/MLSP.2005.1532906PMID 16246587
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar, PubMed

• No claims are published for this paper.

• No concepts are published for this paper.

• An adaptive reflexive processing model of neurocognitive function: supporting evidence from a large scale (n = 100) fMRI study of an auditory oddball task

  2005influential reference
• What is novel in the novelty oddball paradigm? Functional significance of the novelty P3 event-related potential as revealed by independent component analysis.

  2005cited by this paper
• Decision making, the P3, and the locus coeruleus-norepinephrine system.

  2005cited by this paper
• Concurrent EEG/fMRI analysis by multiway Partial Least Squares

  2004cited by this paper
• Parsing the late positive complex: mental chronometry and the ERP components that inhabit the neighborhood of the P300.

  2004cited by this paper
• Anatomy of an error: ERP and fMRI.

  2003cited by this paper
• Optimizing PCA methodology for ERP component identification and measurement: theoretical rationale and empirical evaluation.

  2003cited by this paper
• What aspect of the fMRI BOLD signal best reflects the underlying electrophysiology in human somatosensory cortex?

  2003cited by this paper
• Orbitofrontal cortex and dynamic filtering of emotional stimuli

  2002cited by this paper
• Correlations and dissociations between BOLD signal and P300 amplitude in an auditory oddball task: a parametric approach to combining fMRI and ERP.

  2002cited by this paper
• Correspondence of event‐related potential tomography and functional magnetic resonance imaging during language processing

  2002cited by this paper
• Simultaneous EEG and fMRI of the alpha rhythm

  2002cited by this paper
• What is the best similarity measure for motion correction in fMRI time series?

  2002cited by this paper
• Neural sources involved in auditory target detection and novelty processing: an event-related fMRI study.

  2001cited by this paper
• Paradigm‐dependent modulation of event‐related fMRI activity evoked by the oddball task

  2001cited by this paper
• An event-related functional magnetic resonance imaging study of an auditory oddball task in schizophrenia.

  2001cited by this paper
• Neurophysiological investigation of the basis of the fMRI signal

  2001cited by this paper
• Spatial and temporal independent component analysis of functional MRI data containing a pair of task‐related waveforms

  2001cited by this paper
• Neural origins of the P300.

  2000cited by this paper
• Removing electroencephalographic artifacts by blind source separation.

  2000cited by this paper
• Linear coupling between functional magnetic resonance imaging and evoked potential amplitude in human somatosensory cortex.

  2000cited by this paper
• Dynamic Statistical Parametric Neurotechnique Mapping: Combining fMRI and MEG for High-Resolution Imaging of Cortical Activity

  2000cited by this paper
• Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Subgaussian and Supergaussian Sources

  1999cited by this paper
• Reduced P300 responses in criminal psychopaths during a visual oddball task.

  1999cited by this paper
• Combining electrophysiological and hemodynamic measures of the auditory oddball.

  1999cited by this paper
• Spatiotemporal imaging of human brain activity using functional MRI constrained magnetoencephalography data: Monte Carlo simulations.

  1998cited by this paper
• Attentional orienting and reorienting is indicated by human event‐related brain potentials

  1998cited by this paper
• A Review of EEG and Blood Flow Data

  1998cited by this paper
• Generators of the late cognitive potentials in auditory and visual oddball tasks.

  1998cited by this paper
• Dissociation of brain ERP topographies for tonal and phonetic oddball tasks.

  1998cited by this paper
• Blind separation of auditory event-related brain responses into independent components.

  1997cited by this paper
• Infomax and maximum likelihood for blind source separation

  1997cited by this paper
• A Bayesian approach to introducing anatomo-functional priors in the EEG/MEG inverse problem

  1997cited by this paper
• Infrequent events transiently activate human prefrontal and parietal cortex as measured by functional MRI.

  1997cited by this paper
• Combined event‐related fMRI and EEG evidence for temporal—parietal cortex activation during target detection

  1997cited by this paper
• Spatial registration and normalization of images

  1995cited by this paper
• Neocortical Dynamics and Human EEG Rhythms

  1995cited by this paper
• An Information-Maximization Approach to Blind Separation and Blind Deconvolution

  1995cited by this paper
• Cognitive and biological determinants of P300: an integrative review.

  1995cited by this paper
• Intracerebral potentials to rare target and distractor auditory and visual stimuli. I. Superior temporal plane and parietal lobe.

  1995cited by this paper
• Mismatch negativity--a unique measure of sensory processing in audition.

  1995cited by this paper
• Analysis of fMRI time-series revisited--again.

  1995cited by this paper
• Schizophrenics have fewer and smaller P300s: a single-trial analysis.

  1994cited by this paper
• Probability effects on stimulus evaluation and response processes.

  1992cited by this paper
• Anterior and posterior association cortex contributions to the somatosensory P300

  1991cited by this paper
• Event-related potentials in schizophrenia: their biological and clinical correlates and a new model of schizophrenic pathophysiology.

  1991cited by this paper
• The Spline‐Laplacian in Clinical Neurophysiology: A Method to Improve EEG Spatial Resolution

  1991cited by this paper
• Is the P300 component a manifestation of context updating?

  1988cited by this paper
• Principles of spatial analysis

  1987cited by this paper
• Detection of signals by information theoretic criteria

  1985cited by this paper
• Principal component analysis of ERP differences related to the meaning of an ambiguous word.

  1979cited by this paper
• Information Delivery and the Sensory Evoked Potential

  1967cited by this paper
• Human Brain Mapping 6:160–188(1998) � Analysis of fMRI Data by Blind Separation Into Independent Spatial Components

  year unknowncited by this paper
• �Human Brain Mapping 13:74–93(2001) � Analysis and Use of fMRI Response Delays

  year unknowncited by this paper

• Multimodal fNIRS–EEG sensor fusion: Review of data-driven methods and perspective for naturalistic brain imaging

  2025cites this paper
• Estimating Brain Activity with High Spatial and Temporal Resolution using a Naturalistic MEG-fMRI Encoding Model

  2025cites this paper
• Data-guided neuroimaging and visualization: From functional decomposition to dynamic fusion

  2025cites this paper
• Gray and white matter alterations in Obsessive-Compulsive Personality Disorder: a data fusion machine learning approach

  2025cites this paper
• The Artists’ Brain: A Data Fusion Approach to Characterize the Neural Bases of Professional Visual Artists

  2025influential citation
• Neural fingerprint of the dark triad: Resting state BOLD power (fALFF) alterations in executive and default mode networks

  2025cites this paper
• Unmasking the Dark Triad: A Data Fusion Machine Learning Approach to Characterize the Neural Bases of Narcissistic, Machiavellian and Psychopathic Traits

  2025cites this paper
• Learning Spatiotemporal Brain Dynamics in Adolescents via Multimodal MEG and fMRI Data Fusion Using Joint Tensor/Matrix Decomposition

  2024cites this paper
• Similarities and differences between Chronic Primary Pain and Depression in brain activities: Evidence from Resting-State Microstates and auditory Oddball Task.

  2024cites this paper
• Assessing Pediatric Cognitive Development via Multisensory Brain Imaging Analysis

  2024cites this paper
• Habituation of Central and Electrodermal Responses to an Auditory Two-Stimulus Oddball Paradigm

  2024cites this paper
• Brain–Computer Interfaces for Communication in Patients with Disorders of Consciousness: A Gap Analysis and Scientific Roadmap

  2024cites this paper
• Constrained Independent Vector Analysis With Reference for Multi-Subject fMRI Analysis

  2023cites this paper
• Multimodal subspace independent vector analysis effectively captures the latent relationships between brain structure and function

  2023cites this paper
• Data Fusion-Based Musculoskeletal Synergies in the Grasping Hand

  2022cites this paper
• Multi-Subject Analysis for Brain Developmental Patterns Discovery via Tensor Decomposition of MEG Data

  2022cites this paper
• Joint structural-functional magnetic resonance imaging features are associated with diagnosis and real-world functioning in patients with schizophrenia.

  2022cites this paper
• Modeling the Hemodynamic Response Function Using EEG-fMRI Data During Eyes-Open Resting-State Conditions and Motor Task Execution

  2022cites this paper
• Aberrant Intrinsic Neural Networks Strength in Individuals with "Smartphone Addiction": An MRI Data Fusion Study

  2022cites this paper
• Tracing Evolving Networks Using Tensor Factorizations vs. ICA-Based Approaches

  2022cites this paper
• Coupled tensor decompositions for data fusion

  2022cites this paper
• Brain Region-Based Vigilance Assessment Using Electroencephalography and Eye Tracking Data Fusion

  2022cites this paper
• Rapid Interactions of Widespread Brain Networks Characterize Semantic Cognition

  2022cites this paper
• Simultaneous EEG-fMRI: What Have We Learned and What Does the Future Hold?

  2022cites this paper
• Fusing multimodal neuroimaging data with a variational autoencoder

  2021cites this paper
• Disjoint Subspaces for Common and DistinctComponent Analysis: Application to the Fusion of Multi-taskFMRI Data.

  2021cites this paper
• Null effects of levodopa on reward- and error-based motor adaptation, savings, and anterograde interference.

  2021cites this paper
• When Is Simultaneous Recording Necessary? A Guide for Researchers Considering Combined EEG-fMRI

  2021cites this paper
• The effect of groupness constraint on the sensitivity and specificity of canonical correlation analysis, a multi-modal anatomical and functional MRI study

  2021cites this paper
• Frontal-midline theta reflects different mechanisms associated with proactive and reactive control of inhibition

  2021cites this paper
• Functional, structural, and phenotypic data fusion to predict developmental scores of pre-school children based on Canonical Polyadic Decomposition

  2021cites this paper
• Joint cortical surface and structural connectivity analysis of Alzheimer’s disease

  2021cites this paper
• Consecutive Independence and Correlation Transform for Multimodal Data Fusion: Discovery of One-to-Many Associations in Structural and Functional Imaging Data

  2021cites this paper
• Multimodal Neuroimaging with Simultaneous fMRI and EEG

  2021cites this paper
• Early soft and flexible fusion of electroencephalography and functional magnetic resonance imaging via double coupled matrix tensor factorization for multisubject group analysis

  2021cites this paper
• Relationship between Dynamic Blood-Oxygen-Level-Dependent Activity and Functional Network Connectivity: Characterization of Schizophrenia Subgroups

  2021influential citation
• Multimodal integration

  2020cites this paper
• The role of dopamine in reward-based motor adaptation, savings, and interference

  2020cites this paper
• Exploring joint patterns of brain structure and function in inflammatory bowel diseases using multimodal data fusion

  2020cites this paper
• Early soft and flexible fusion of EEG and fMRI via tensor decompositions

  2020influential citation
• Joint-IVA for identification of discriminating features in EEG: Application to a driving study

  2020cites this paper
• The Developmental Chronnecto-Genomics (Dev-CoG) study: A multimodal study on the developing brain

  2020cites this paper
• Disjoint Subspaces for Common and Distinct Component Analysis: Application to Task FMRI Data

  2019cites this paper
• “Hit the missing stimulus”. A simultaneous EEG-fMRI study to localize the generators of endogenous ERPs in an omitted target paradigm

  2019cites this paper
• Early Detection of Mental Stress Using Advanced Neuroimaging and Artificial Intelligence

  2019cites this paper
• How to Integrate Data from Multiple Biological Layers in Mental Health?

  2019cites this paper
• Unraveling Diagnostic Biomarkers of Schizophrenia Through Structure-Revealing Fusion of Multi-Modal Neuroimaging Data

  2019influential citation
• C-ICT for Discovery of Multiple Associations in Multimodal Imaging Data: Application to Fusion of fMRI and DTI Data

  2019cites this paper
• ICA and IVA for Data Fusion: An Overview and a New Approach Based on Disjoint Subspaces

  2019cites this paper
• Cortical Topography of Error-Related High-Frequency Potentials During Erroneous Control in a Continuous Control Brain–Computer Interface

  2019cites this paper
• Structural and Functional Connectivity: A Combined Analysis of Patients with Multiple Sclerosis Using Joint-ICA

  2019cites this paper
• Amyloid and tau accumulate across distinct spatial networks and are differentially associated with brain connectivity

  2019influential citation
• Enabling Brain-Computer Interface Co-Adaptation with Performance-Related Signals

  2019influential citation
• Fusion of EEG and fMRI via Soft Coupled Tensor Decompositions

  2018influential citation
• The Construction of Large-Scale Cortical Networks for P300 From Scalp EEG

  2018cites this paper
• Cortical processing of location changes in a “cocktail‐party” situation: Spatial oddball effects on electrophysiological correlates of auditory selective attention

  2018cites this paper
• 11-11-2010 MEG and f MRI Fusion for Non-Linear Estimation of Neural and BOLD Signal Changes

  2018cites this paper
• Simultaneous task-based BOLD-fMRI and [18-F] FDG functional PET for measurement of neuronal metabolism in the human visual cortex

  2018cites this paper
• Remote Sensing Data Fusion: Guided Filter-Based Hyperspectral Pansharpening and Graph-Based Feature-Level Fusion

  2018cites this paper
• Consecutive Independence and Correlation Transform for Multimodal Fusion: Application to Eeg and Fmri Data

  2018cites this paper
• Spatio–temporal patterns of cognitive control revealed with simultaneous electroencephalography and functional magnetic resonance imaging

  2018cites this paper
• EEG Source Imaging and Multimodal Neuroimaging

  2018cites this paper
• Optimizing Within-Subject Experimental Designs for jICA of Multi-Channel ERP and fMRI

  2018cites this paper
• Psychopathic traits associated with abnormal hemodynamic activity in salience and default mode networks during auditory oddball task

  2018cites this paper
• Moving Beyond ERP Components: A Selective Review of Approaches to Integrate EEG and Behavior

  2018cites this paper
• Simultaneous EEG-fMRI Study of Audiovisual Sensory Processing

  2017cites this paper
• How to Build a Hybrid Neurofeedback Platform Combining EEG and fMRI

  2017influential citation
• A Realistic Framework for Investigating Decision Making in the Brain With High Spatiotemporal Resolution Using Simultaneous EEG/fMRI and Joint ICA

  2017cites this paper
• Quantifying the Interaction and Contribution of Multiple Datasets in Fusion: Application to the Detection of Schizophrenia

  2017cites this paper
• ACMTF for fusion of multi-modal neuroimaging data and identification of biomarkers

  2017cites this paper
• Tensor decompositions and data fusion in epileptic electroencephalography and functional magnetic resonance imaging data

  2017cites this paper
• Löwner-Based Blind Signal Separation of Rational Functions With Applications

  2016cites this paper
• Simultaneous EEG-fMRI for working memory of the human brain

  2016cites this paper
• Tensor-based fusion of EEG and FMRI to understand neurological changes in schizophrenia

  2016cites this paper
• Fusion of electroencephalography and functional magnetic resonance imaging to explore epileptic network activity

  2016cites this paper
• Multimodal fusion of brain imaging data: A key to finding the missing link(s) in complex mental illness.

  2016cites this paper
• Feature-based MRI data fusion for cardiac arrhythmia studies

  2016cites this paper
• Mental stress assessment using simultaneous measurement of EEG and fNIRS.

  2016cites this paper
• Sample-poor estimation of order and common signal subspace with application to fusion of medical imaging data

  2016cites this paper
• Expanding Your Cognitive Capacity: An Assessment of the Neuroplastic Changes Associated with Mindfulness Training and Transcranial Stimulation

  2016cites this paper
• Role of diversity in ICA and IVA: theory and applications

  2016cites this paper
• Linked Component Analysis From Matrices to High-Order Tensors: Applications to Biomedical Data

  2015cites this paper
• Multimodal Data Fusion Using Source Separation: Application to Medical Imaging

  2015cites this paper
• Characterizing nonlinear relationships in functional imaging data using eigenspace maximal information canonical correlation analysis (emiCCA)

  2015cites this paper
• Anorexia nervosa and body dysmorphic disorder are associated with abnormalities in processing visual information

  2015influential citation
• Hyperscanning neuroimaging technique to reveal the "two-in-one" system in social interactions.

  2015cites this paper
• Multivariate Fusion of EEG and Functional MRI Data Using ICA: Algorithm Choice and Performance Analysis

  2015cites this paper
• Beta oscillations and reward processing: Coupling oscillatory activity and hemodynamic responses

  2015influential citation
• Decomposition methods for the fusion of multimodal neuroimaging data

  2015cites this paper
• Impaired target detection in schizophrenia and the ventral attentional network: Findings from a joint event-related potential–functional MRI analysis

  2015influential citation
• Combining fMRI with Other Modalities: Multimodal Neuroimaging

  2015cites this paper
• Data Fusion in Metabolomics Using Coupled Matrix and Tensor Factorizations

  2015cites this paper
• Multimodal Data Fusion Using Source Separation: Two Effective Models Based on ICA and IVA and Their Properties

  2015influential citation
• Joint Coupling of Awake EEG Frequency Activity and MRI Gray Matter Volumes in the Psychosis Dimension: A BSNIP Study

  2015cites this paper
• The role of high-frequency oscillatory activity in reward processing and learning.

  2015cites this paper
• Multimodal Data Fusion: An Overview of Methods, Challenges, and Prospects

  2015cites this paper
• Multivariate Machine Learning Methods for Fusing Multimodal Functional Neuroimaging Data

  2015cites this paper
• The role of visual processing in motor learning and control: Insights from electroencephalography.

  2015cites this paper
• Latent Variable Analysis and Signal Separation

  2015cites this paper
• Exploring the epileptic network with parallel ICA of interictal EEG-FMRI

  2015cites this paper