Enhancing vision-and-language transformers through two-stage generative alignment pre-training

No abstract is available for this paper.

• Publication year

  2026

• Venue

  Engineering applications of artificial intelligence

• Publication date

  2026-01-01

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.1016/j.engappai.2025.113076
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• A Transformer-based self-supervised learning model for fault diagnosis of air-conditioning systems with limited labeled data

  2025cited by this paper
• Seeing Through VisualBERT: A Causal Adventure on Memetic Landscapes

  2024cited by this paper
• Enhancing Visual Grounding in Vision-Language Pre-Training With Position-Guided Text Prompts

  2023cited by this paper
• BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation

  2022cited by this paper
• Unifying Vision-and-Language Tasks via Text Generation

  2021cited by this paper
• Align before Fuse: Vision and Language Representation Learning with Momentum Distillation

  2021cited by this paper
• Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision

  2021cited by this paper
• Language Models are Few-Shot Learners

  2020cited by this paper
• Training data-efficient image transformers & distillation through attention

  2020cited by this paper
• Momentum Contrast for Unsupervised Visual Representation Learning

  2019cited by this paper
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  2019cited by this paper
• Unified Vision-Language Pre-Training for Image Captioning and VQA

  2019cited by this paper
• Attention is All you Need

  2017cited by this paper
• Multimodal Machine Learning: A Survey and Taxonomy

  2017cited by this paper
• Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotations

  2016cited by this paper
• SPICE: Semantic Propositional Image Caption Evaluation

  2016cited by this paper
• Deep Residual Learning for Image Recognition

  2015cited by this paper
• CIDEr: Consensus-based image description evaluation

  2014cited by this paper
• Microsoft COCO: Common Objects in Context

  2014cited by this paper
• Bleu: a Method for Automatic Evaluation of Machine Translation

  2002cited by this paper

• No citing papers are available for this paper.