Modality-Agnostic Decoding of Vision and Language from fMRI

No abstract is available for this paper.

• Publication year

  2025

• Venue

  bioRxiv

• Publication date

  2025-10-17

• Fields of study

  Biology, Computer Science

• Identifiers
  DOI 10.1101/2025.06.08.658221
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Visual mental imagery in typical imagers and in aphantasia: A millimeter-scale 7-T fMRI study

  2024cited by this paper
• PaliGemma 2: A Family of Versatile VLMs for Transfer

  2024cited by this paper
• DINOv2: Learning Robust Visual Features without Supervision

  2023cited by this paper
• Brain decoding: toward real-time reconstruction of visual perception

  2023cited by this paper
• High-resolution image reconstruction with latent diffusion models from human brain activity

  2023cited by this paper
• Decoding semantic representations in mind and brain.

  2023cited by this paper
• BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models

  2023cited by this paper
• ImageBind One Embedding Space to Bind Them All

  2023cited by this paper
• Sigmoid Loss for Language Image Pre-Training

  2023cited by this paper
• Natural scene reconstruction from fMRI signals using generative latent diffusion

  2023cited by this paper
• Llama 2: Open Foundation and Fine-Tuned Chat Models

  2023cited by this paper
• Brain encoding models based on multimodal transformers can transfer across language and vision

  2023cited by this paper
• Bridge-Tower: Building Bridges Between Encoders in Vision-Language Representation Learning

  2022cited by this paper
• The connectional anatomy of visual mental imagery: evidence from a patient with left occipito-temporal damage

  2022cited by this paper
• Mind Reader: Reconstructing complex images from brain activities

  2022cited by this paper
• Semantic reconstruction of continuous language from non-invasive brain recordings

  2022influential reference
• Decoding the information structure underlying the neural representation of concepts

  2022cited by this paper
• The “Narratives” fMRI dataset for evaluating models of naturalistic language comprehension

  2021cited by this paper
• A massive 7T fMRI dataset to bridge cognitive neuroscience and artificial intelligence

  2021cited by this paper
• FLAVA: A Foundational Language And Vision Alignment Model

  2021cited by this paper
• Visual and linguistic semantic representations are aligned at the border of human visual cortex

  2021influential reference
• A Distributed Network for Multimodal Experiential Representation of Concepts

  2021cited by this paper
• A network linking scene perception and spatial memory systems in posterior cerebral cortex

  2021cited by this paper
• Hemispheric asymmetries in visual mental imagery

  2021cited by this paper
• ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision

  2021cited by this paper
• Learning Transferable Visual Models From Natural Language Supervision

  2021cited by this paper
• An fMRI dataset in response to “The Grand Budapest Hotel”, a socially-rich, naturalistic movie

  2020cited by this paper
• General and feature-based semantic representations in the semantic network

  2020cited by this paper
• A naturalistic neuroimaging database for understanding the brain using ecological stimuli

  2020cited by this paper
• Visual mental imagery engages the left fusiform gyrus, but not the early visual cortex: a meta-analysis of neuroimaging evidence

  2020cited by this paper
• An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale

  2020cited by this paper
• Distinct fronto-temporal substrates of distributional and taxonomic similarity among words: evidence from RSA of BOLD signals

  2020cited by this paper
• Shared Neural Mechanisms of Visual Perception and Imagery.

  2019cited by this paper
• Hierarchical structure guides rapid linguistic predictions during naturalistic listening

  2019cited by this paper
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  2019cited by this paper
• From voxels to pixels and back: Self-supervision in natural-image reconstruction from fMRI

  2019cited by this paper
• A 204-subject multimodal neuroimaging dataset to study language processing

  2019cited by this paper
• The human imagination: the cognitive neuroscience of visual mental imagery

  2019cited by this paper
• The dynamic contribution of the high‐level visual cortex to imagery and perception

  2019cited by this paper
• VisualBERT: A Simple and Performant Baseline for Vision and Language

  2019cited by this paper
• Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks

  2019cited by this paper
• Empirical Linguistic Study of Sentence Embeddings

  2019cited by this paper
• Language Models are Unsupervised Multitask Learners

  2019cited by this paper
• Toward a universal decoder of linguistic meaning from brain activation

  2018cited by this paper
• Modality-Independent Coding of Scene Categories in Prefrontal Cortex

  2018cited by this paper
• Reconstructing faces from fMRI patterns using deep generative neural networks

  2018cited by this paper
• BOLD5000, a public fMRI dataset while viewing 5000 visual images

  2018cited by this paper
• Integrative and distinctive coding of visual and conceptual object features in the ventral visual stream

  2018cited by this paper
• Cross‐modal representation of spoken and written word meaning in left pars triangularis

  2017cited by this paper
• Deep image reconstruction from human brain activity

  2017cited by this paper
• Language in Our Brain: The Origins of a Uniquely Human Capacity

  2017cited by this paper
• Decoding across sensory modalities reveals common supramodal signatures of conscious perception

  2017cited by this paper
• The Hub-and-Spoke Hypothesis of Semantic Memory

  2016cited by this paper
• The neural and computational bases of semantic cognition

  2016influential reference
• In defense of abstract conceptual representations

  2016cited by this paper
• On Staying Grounded and Avoiding Quixotic Dead Ends

  2016cited by this paper
• How concepts are encoded in the human brain: A modality independent, category-based cortical organization of semantic knowledge

  2016influential reference
• Situation models, mental simulations, and abstract concepts in discourse comprehension

  2015cited by this paper
• Deep Residual Learning for Image Recognition

  2015cited by this paper
• A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes

  2015cited by this paper
• GRAPES—Grounding representations in action, perception, and emotion systems: How object properties and categories are represented in the human brain

  2015cited by this paper
• Microsoft COCO: Common Objects in Context

  2014cited by this paper
• Modality-independent decoding of semantic information from the human brain.

  2014influential reference
• Reconciling Embodied and Distributional Accounts of Meaning in Language

  2014cited by this paper
• Representational Similarity Analysis Reveals Commonalities and Differences in the Semantic Processing of Words and Objects

  2013influential reference
• Brain Regions That Represent Amodal Conceptual Knowledge

  2013influential reference
• Shared representations for working memory and mental imagery in early visual cortex.

  2013cited by this paper
• FreeSurfer

  2012cited by this paper
• A continuous semantic space describes the representation of thousands of object and action categories across the human brain.

  2012cited by this paper
• Sight and Sound Converge to Form Modality-Invariant Representations in Temporoparietal Cortex

  2012influential reference
• Spurious but systematic correlations in functional connectivity MRI networks arise from subject motion

  2012cited by this paper
• Disentangling visual imagery and perception of real-world objects

  2012influential reference
• Conceptual representations in mind and brain: theoretical developments, current evidence and future directions.

  2012cited by this paper
• Statistical inference and multiple testing correction in classification-based multi-voxel pattern analysis (MVPA): Random permutations and cluster size control

  2011cited by this paper
• Commonality of neural representations of words and pictures

  2011influential reference
• Scikit-learn: Machine Learning in Python

  2011cited by this paper
• Reconstructing visual experiences from brain activity evoked by natural movies.

  2011cited by this paper
• Nipype: A Flexible, Lightweight and Extensible Neuroimaging Data Processing Framework in Python

  2011cited by this paper
• Encoding and decoding in fMRI

  2011cited by this paper
• Decoding individual natural scene representations during perception and imagery

  2010cited by this paper
• Distortion correction for diffusion‐weighted MRI tractography and fMRI in the temporal lobes

  2010cited by this paper
• Reading the mind's eye: Decoding category information during mental imagery

  2010influential reference
• New method for fMRI investigations of language: defining ROIs functionally in individual subjects.

  2010cited by this paper
• Comprehension of concrete and abstract words in semantic dementia.

  2009cited by this paper
• Bayesian reconstruction of natural images from human brain activity.

  2009cited by this paper
• Convergence and divergence in a neural architecture for recognition and memory.

  2009influential reference
• Top-Down Activation of Shape-Specific Population Codes in Visual Cortex during Mental Imagery

  2009cited by this paper
• Threshold-free cluster enhancement: Addressing problems of smoothing, threshold dependence and localisation in cluster inference

  2009cited by this paper
• Identifying natural images from human brain activity

  2008cited by this paper
• Neural basis of category-specific semantic deficits for living things: evidence from semantic dementia, HSVE and a neural network model.

  2006cited by this paper
• An automated labeling system for subdividing the human cerebral cortex on MRI scans into gyral based regions of interest

  2006cited by this paper
• Global workspace theory of consciousness: toward a cognitive neuroscience of human experience.

  2005influential reference
• Neural systems behind word and concept retrieval.

  2004cited by this paper
• Unitary vs multiple semantics: PET studies of word and picture processing.

  2004cited by this paper
• Structure and deterioration of semantic memory: a neuropsychological and computational investigation.

  2004cited by this paper
• The human visual cortex.

  2004cited by this paper
• Functional magnetic resonance imaging (fMRI) "brain reading": detecting and classifying distributed patterns of fMRI activity in human visual cortex

  2003cited by this paper
• THE SIMILARITY-IN-TOPOGRAPHY PRINCIPLE: RECONCILING THEORIES OF CONCEPTUAL DEFICITS

  2003cited by this paper
• When is early visual cortex activated during visual mental imagery?

  2003cited by this paper
• The relationship between visual perception and visual mental imagery: a reappraisal of the neuropsychological evidence.

  2002cited by this paper

• No citing papers are available for this paper.