GPT-4 Technical Report

We report the development of GPT-4, a large-scale, multimodal model which can accept image and text inputs and produce text outputs. While less capable than humans in many real-world scenarios, GPT-4 exhibits human-level performance on various professional and academic benchmarks, including passing a simulated bar exam with a score around the top 10% of test takers. GPT-4 is a Transformer-based model pre-trained to predict the next token in a document. The post-training alignment process results in improved performance on measures of factuality and adherence to desired behavior. A core component of this project was developing infrastructure and optimization methods that behave predictably across a wide range of scales. This allowed us to accurately predict some aspects of GPT-4's performance based on models trained with no more than 1/1,000th the compute of GPT-4.

• Publication year

  2023

• Venue

  Unknown venue

• Publication date

  2023-03-15

• Fields of study

  Computer Science

• Identifiers
  arXiv 2303.08774
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• No references are available for this paper.

• Based on Tensor Core Sparse Kernels Accelerating Deep Neural Networks

  2026cites this paper
• Navigating Embodied Intelligence: Enabling Technologies, Security and Privacy, and Emerging Trends

  2026cites this paper
• MAMoE: A Multi-Agent Mixture-of-Experts Framework for LLM-Assisted 3D Object Reconstruction and Transmission

  2026cites this paper
• HybridMoE: LoRA-Based LLMs Fine-Tune With Hybrid Mixture of Experts

  2026cites this paper
• Words Strip Wardrobe: Learning Invariant Textual Prompts for Cloth-Changing Person Re-Identification

  2026cites this paper
• METS: Metadata-Embedded Steganography for Digital Rights Tracking in LLM-Generated Text

  2026cites this paper
• Missing Data Recovery Methods on Multivariate Time Series in IoT: A Comprehensive Survey

  2026cites this paper
• GAIA: Generating Task Instruction Aware Simulation Grounded in Real Contexts Using Vision-Language Models

  2026cites this paper
• Joint Trajectory and Link Quality Prediction in LAENets via Multi-Task Time-Series Large Models

  2026cites this paper
• Community of inquiry in motion: Modeling inquiry dynamics with movement analysis (MOVA)

  2026cites this paper
• Robust Task Planning via Failure Detection Using Scene Graph From Multi-View Images

  2026cites this paper
• Collection-driven and resolution-aware prompt learning for few-shot remote sensing scene classification

  2026cites this paper
• Evolutionary-Algorithm-Based Automatic Prompt Generation for Vision-Language Model Evaluation

  2026cites this paper
• Planes, Not A380: How Prompting, Context, and Granularity Shape VLM Performance in Aerial Imagery

  2026cites this paper
• RFSensingGPT: A Multi-Modal RAG-Enhanced Framework for Integrated Sensing and Communications Intelligence in 6G Networks

  2026influential citation
• DANCE++: Differentiable Accelerator/Network Co-Exploration With Hard Constraints and Data-Free Training for Real-World Scenarios

  2026cites this paper
• AIGC-Enhanced Federated Learning: Addressing Data Scarcity in Preference-Based Scenarios

  2026cites this paper
• Cognitive Internet of Things: A Review of Theory, Applications, and Recent Advances

  2026cites this paper
• Federated Retrieval-Augmented Generation-Based LLM for Enhanced Cyber Threat Detection in the Internet-of-Energy

  2026cites this paper
• Generative Approach for Detecting Small Intrusive Foreign Objects in High-Speed Railway Scenario

  2026influential citation
• Sculpting Resource Efficiency: Diffusion Model-Aided Dynamic Multi-Job Scheduling With Topology Awareness in AI Clusters

  2026cites this paper
• Large (Vision) Language Models for Autonomous Vehicles: Current Trends and Future Directions

  2026cites this paper
• DualFocus-CapNet: A Dual-Stream Network for Real Change and Interscale Relationship-Aware Change Captioning in Remote Sensing Images

  2026cites this paper
• Emotion-Aware LLM Adaptation for Empathetic Dialogue Generation

  2026cites this paper
• Exacerbating Differences in Polarity: Bias Adversarial Attack on Generative Large Language Models

  2026influential citation
• Variational Dehallucination via Retrieval-Augmented Prompt Learning

  2026cites this paper
• DiffuSaL: Diffusion-Based Scene and Label Space Extension for Domain Generalization in Driving-Scene Semantic Segmentation

  2026cites this paper
• Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Survey

  2026cites this paper
• Contrastive Learning-Enhanced Chain-of-Thought Optimization for Complex Table Question Answering

  2026cites this paper
• YOLOSAM: A YOLO-Guided SAM for Accurate Building Segmentation in Remote Sensing Images

  2026cites this paper
• SlowFocus: Enhancing Fine-grained Temporal Understanding in Video LLM

  2026cites this paper
• Trustworthy Driver State Perception via Contextual Interaction-Driven Evidential Vision-Language Fusion in Vehicular Cyber-Physical Systems

  2026cites this paper
• A 22-nm 109.3-to-249.5-TFLOPS/W Outlier-Aware Floating-Point SRAM Compute-in-Memory Macro for Large Language Models

  2026cites this paper
• Leveraging LLMs in Cloud–Edge Networks for Traffic Risk Prediction and Accident Severity Analysis

  2026cites this paper
• NFV-Based Security Estimation and Classification Approaches for AIGC-Enabled Edge Networks

  2026cites this paper
• ERFC: Energy-Aware Reinforcement Feedback Calibration for Zero-Shot Captioning

  2026cites this paper
• ComAI: The Convergence of Communication and Artificial Intelligence

  2026cites this paper
• Regression in Earth Observation: Are vision–language models up to the challenge?

  2026cites this paper
• Interview-Based Depression Detection Using LLM-Based Text Restatement and Emotion Lexicon

  2026cites this paper
• Evaluating the Adversarial Robustness of Vision-Language Models via Internal Feature Perturbations

  2026cites this paper
• Disguise While Defense: Avoid Refusal Responses in LLM’s Defense via a Multi-Agent Attacker–Disguiser Game

  2026cites this paper
• Modularity is the Bedrock of Natural and Artificial Intelligence

  2026cites this paper
• Cas-OVD: Cascaded Open-Vocabulary Detection of Small Objects Using Multi-Refined Region Proposal Network in Autonomous Driving

  2026cites this paper
• End-to-End Autonomous Driving: From Classic Paradigm to Large Model Empowerment—A Comprehensive Survey

  2026cites this paper
• ELLA: Efficient Lifelong Learning for Adapters in Large Language Models

  2026cites this paper
• SageCopilot: An LLM-Empowered Autonomous Agent for Data Science as a Service

  2026cites this paper
• EALLMs: Environment-Aligned LLMs for Enhanced Exploration and Communication in Multi-Agent Reinforcement Learning

  2026cites this paper
• A Hybrid Online and Offline Requests Inference Serving System for LLM in Private Computer Environment

  2026cites this paper
• Photonic Neural Networks: Principles, Progress, and Prospects Toward Streaming Processes

  2026cites this paper
• DEFT: Data-Efficient Fine-Tuning Through Multi-Dimensional Data Selection

  2026cites this paper
• Automated Bloom's Taxonomy Classification of Teacher Questions Using Whisper and GPT-4

  2026cites this paper
• AnyoneCue: Gloss-Prompted Fine-Grained and Personalized Cued Speech Video Generation

  2026cites this paper
• Graph Transformer for Tri-Beamforming in Pinching Antenna Systems (PASS)

  2026cites this paper
• Dual Preference Learning for Multi-Agent Reinforcement Learning

  2026influential citation
• Multitask unified large vision-language model for post-earthquake structural damage assessment of buildings

  2026cites this paper
• Distributed Modularization of Thought: Lets Small Rival Large LMs

  2026cites this paper
• Intelligence by design: Large language model work integration as strategic enablers for supply chain regeneration through digital and cognitive capabilities

  2026cites this paper
• Dual-Prompt-Aware Cross-Modal Semantic Interaction and Fusion Network for Remote Sensing Image Captioning

  2026cites this paper
• Policy-Guided Search on Tree-of-Thoughts for Efficient Problem Solving with Bounded Language Model Queries

  2026cites this paper
• Toward Comprehensive Interactive Change Understanding in Remote Sensing: A Large-Scale Dataset and Dual-Granularity Enhanced VLM

  2026cites this paper
• Natural Language to Code for Automated Annotation in Autonomous Driving

  2026cites this paper
• Diversified Prompting Strategy for Improving Slot Filling With Large Language Models

  2026cites this paper
• Generation-Based and Emotion-Reflected Memory Update: Creating the KEEM Dataset for Better Long-Term Conversation

  2026cites this paper
• FPO: Fine-Grained Preference Optimization Improves Zero-Shot Text-to-Speech

  2026cites this paper
• Toward General-Purpose Video Reconstruction Through Synergy of Grid-Splicing Diffusion and Large Language Models

  2026cites this paper
• Not All Attention is Needed: Parameter and Computation Efficient Tuning for Multi-modal Large Language Models via Effective Attention Skipping

  2026cites this paper
• DiViCo: Disentangled Visual Token Compression for Efficient Large Vision-Language Model

  2026cites this paper
• Atelier: An Automated Analog Circuit Design Framework via Multiple Large Language Model-Based Agents

  2026influential citation
• Toward General Industrial Intelligence: A Survey of Large Models as a Service in Industrial IoT

  2026cites this paper
• Latent Variable Modeling for Controllable and Diverse Generation From Large Language Models

  2026cites this paper
• STELLA: Towards a Biomedical World Model with Self-Evolving Multimodal Agents

  2026cites this paper
• LSSF: Safety Alignment for Large Language Models through Low-Rank Safety Subspace Fusion

  2026cites this paper
• RoboCleaner: Robotic Tabletop Cleaning via VLM-Powered Multi-Agent Collaboration

  2026cites this paper
• HyDAS: Hybrid Domain Deformed Attention for Selective Hotspot Detection

  2026cites this paper
• Extracting and Following Paths for Robust Relational Reasoning with Large Language Models

  2026cites this paper
• Joint Inference Offloading and Model Caching for Small and Large Language Model Collaboration

  2026cites this paper
• Evaluating Natural Language Processing and Named Entity Recognition for Bioarchaeological Data Reuse

  2026cites this paper
• A High-Speed FPGA Implementation for IVF-PQ Index Construction

  2026cites this paper
• TowerDNA: Fast and Accurate Graph Retrieval With Dividing, Contrasting and Alignment

  2026cites this paper
• Evidence from Formal Logical Reasoning Reveals that the Language of Thought is not Natural Language

  2026cites this paper
• EdgeNetLLM: Cloud–Edge Collaborative Adaptation of Large Language Models for Mobile Networking

  2026cites this paper
• scChat: A Large Language Model-Powered Co-Pilot for Contextualized Single-Cell RNA Sequencing Analysis

  2026cites this paper
• MI-LLM: Multiplier-Free LLM Inference on Commodity Processing-in-Memory Hardware

  2026cites this paper
• LBKD: Rethinking Federated Backdoors for Low-Altitude Economy via LLMs and Bidirectional Knowledge Distillation

  2026cites this paper
• Hallucination Elimination and Text Annotation Framework for Large Vision-Language Models in Traffic Scenarios

  2026cites this paper
• Multimodal UNcommonsense: From Odd to Ordinary and Ordinary to Odd

  2026cites this paper
• Edge-Enhanced Intelligence: A Comprehensive Survey of Large Language Models and Edge-Cloud Computing Synergy

  2026cites this paper
• The Power of Small LLMs: A Multi-Agent for Code Generation via Dynamic Precaution Tuning

  2026cites this paper
• Exploring Context-Free Opinion Grammar for Aspect-Based Sentiment Analysis

  2026influential citation
• TrafSeqFormer: Sequence Modeling With Multiagent Reinforcement Learning for Adaptive Traffic Signal Control

  2026cites this paper
• Modeling High-Order Semantic Abstraction and Temporal Interaction for Remote Sensing Change Detection

  2026cites this paper
• Bridging the computational-experimental gap: leveraging large language model to prioritize Alzheimer’s therapeutics based on comparison of learning models

  2026cites this paper
• Consumer Sentiment-Driven Product Ranking Using a Feature-Level Deep Learning Approach: The Case of New and Refurbished Laptops

  2026influential citation
• Enhancing Robotaxi Pick-Up Through Vision-Language-Model-Based Passenger Identification

  2026cites this paper
• Bayesian Inference-Aided Large Language Model Agents in Infinitely Repeated Games: A Dynamic Network View

  2026cites this paper
• Advancing LLM-Generated Code Reliability: A Hybrid Approach for Hallucination Detection

  2026cites this paper
• SAM4CH4: Zero-Shot Methane Plume Mapping With Segment Anything and Vision-Language Models

  2026cites this paper
• LLM-Guided Distributed Model Predictive Control for Decentralized UAV Formations

  2026cites this paper
• ESA-Net: An Efficient and Lightweight Model for Medical Image Segmentation

  2026cites this paper
• Artificial intelligence-driven approaches for materials design and discovery

  2026cites this paper