A Brief Overview of ChatGPT: The History, Status Quo and Potential Future Development

ChatGPT, an artificial intelligence generated content (AIGC) model developed by OpenAI, has attracted world-wide attention for its capability of dealing with challenging language understanding and generation tasks in the form of conversations. This paper briefly provides an overview on the history, status quo and potential future development of ChatGPT, helping to provide an entry point to think about ChatGPT. Specifically, from the limited open-accessed resources, we conclude the core techniques of ChatGPT, mainly including large-scale language models, in-context learning, reinforcement learning from human feedback and the key technical steps for developing Chat-GPT. We further analyze the pros and cons of ChatGPT and we rethink the duality of ChatGPT in various fields. Although it has been widely acknowledged that ChatGPT brings plenty of opportunities for various fields, mankind should still treat and use ChatGPT properly to avoid the potential threat, e.g., academic integrity and safety challenge. Finally, we discuss several open problems as the potential development of ChatGPT.

• Publication year

  2023

• Venue

  IEEE/CAA Journal of Automatica Sinica

• Publication date

  2023-05-01

• Fields of study

  Linguistics, Computer Science

• Identifiers
  DOI 10.1109/JAS.2023.123618
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• GPT-4 Technical Report

  2023cited by this paper
• What Does ChatGPT Say: The DAO from Algorithmic Intelligence to Linguistic Intelligence

  2023cited by this paper
• Is ChatGPT a General-Purpose Natural Language Processing Task Solver?

  2023influential reference
• Translating Natural Language to Planning Goals with Large-Language Models

  2023cited by this paper
• Toolformer: Language Models Can Teach Themselves to Use Tools

  2023cited by this paper
• A Multitask, Multilingual, Multimodal Evaluation of ChatGPT on Reasoning, Hallucination, and Interactivity

  2023cited by this paper
• A Categorical Archive of ChatGPT Failures

  2023cited by this paper
• What ChatGPT and generative AI mean for science

  2023cited by this paper
• Evaluating large language models in theory of mind tasks

  2023cited by this paper
• Mathematical Capabilities of ChatGPT

  2023cited by this paper
• A Tutorial on Meta-Reinforcement Learning

  2023cited by this paper
• ChatGPT listed as author on research papers: many scientists disapprove

  2023cited by this paper
• Knowledge Reasoning via Jointly Modeling Knowledge Graphs and Soft Rules

  2023cited by this paper
• Enabling AI-Generated Content (AIGC) Services in Wireless Edge Networks

  2023cited by this paper
• Self-Refine: Iterative Refinement with Self-Feedback

  2023cited by this paper
• Chat with ChatGPT on Industry 5.0: Learning and Decision-Making for Intelligent Industries

  2023cited by this paper
• DAO to HANOI via DeSci: AI Paradigm Shifts from AlphaGo to ChatGPT

  2023cited by this paper
• Sparks of Artificial General Intelligence: Early experiments with GPT-4

  2023cited by this paper
• Context-faithful Prompting for Large Language Models

  2023cited by this paper
• Holistic Evaluation of Language Models

  2023cited by this paper
• Is ChatGPT A Good Translator? Yes With GPT-4 As The Engine

  2023cited by this paper
• ART: Automatic multi-step reasoning and tool-use for large language models

  2023cited by this paper
• A Generalist Agent

  2022cited by this paper
• Hierarchical Text-Conditional Image Generation with CLIP Latents

  2022cited by this paper
• Self-Consistency Improves Chain of Thought Reasoning in Language Models

  2022cited by this paper
• Survey on Large Scale Neural Network Training

  2022cited by this paper
• Training language models to follow instructions with human feedback

  2022influential reference
• Chain of Thought Prompting Elicits Reasoning in Large Language Models

  2022cited by this paper
• Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

  2022cited by this paper
• Price-Based Residential Demand Response Management in Smart Grids: A Reinforcement Learning-Based Approach

  2022cited by this paper
• Memory-assisted prompt editing to improve GPT-3 after deployment

  2022cited by this paper
• Towards Reasoning in Large Language Models: A Survey

  2022cited by this paper
• Performance of ChatGPT on USMLE: Potential for AI-assisted medical education using large language models

  2022cited by this paper
• Large Language Models are reasoners with Self-Verification

  2022cited by this paper
• High-speed quadrupedal locomotion by imitation-relaxation reinforcement learning

  2022cited by this paper
• Learning to Answer Complex Visual Questions from Multi-View Analysis

  2022cited by this paper
• Visual Semantic Segmentation Based on Few/Zero-Shot Learning: An Overview

  2022influential reference
• Generating Hierarchical Explanations on Text Classification Without Connecting Rules

  2022cited by this paper
• Scaling Instruction-Finetuned Language Models

  2022cited by this paper
• Automatic Chain of Thought Prompting in Large Language Models

  2022cited by this paper
• Improving alignment of dialogue agents via targeted human judgements

  2022cited by this paper
• Make-A-Video: Text-to-Video Generation without Text-Video Data

  2022influential reference
• Diffusion Models: A Comprehensive Survey of Methods and Applications

  2022cited by this paper
• CDP-GAN: Near-Infrared and Visible Image Fusion Via Color Distribution Preserved GAN

  2022cited by this paper
• Efficient Exploration for Multi-Agent Reinforcement Learning via Transferable Successor Features

  2022cited by this paper
• Glioma Segmentation-Oriented Multi-Modal MR Image Fusion With Adversarial Learning

  2022cited by this paper
• Visuals to Text: A Comprehensive Review on Automatic Image Captioning

  2022cited by this paper
• Networked Knowledge and Complex Networks: An Engineering View

  2022cited by this paper
• Dynamic Planning in Open-Ended Dialogue using Reinforcement Learning

  2022cited by this paper
• Emergent Abilities of Large Language Models

  2022cited by this paper
• Large Language Models are Zero-Shot Reasoners

  2022cited by this paper
• Least-to-Most Prompting Enables Complex Reasoning in Large Language Models

  2022cited by this paper
• Learning Transferable Visual Models From Natural Language Supervision

  2021cited by this paper
• A novel automatic classification system based on hybrid unsupervised and supervised machine learning for electrospun nanofibers

  2021cited by this paper
• Randomized Ensembled Double Q-Learning: Learning Fast Without a Model

  2021cited by this paper
• Robotic Knee Tracking Control to Mimic the Intact Human Knee Profile Based on Actor-Critic Reinforcement Learning

  2021cited by this paper
• Total Variation Constrained Non-Negative Matrix Factorization for Medical Image Registration

  2021cited by this paper
• Revisiting the Weaknesses of Reinforcement Learning for Neural Machine Translation

  2021cited by this paper
• Tianshou: a Highly Modularized Deep Reinforcement Learning Library

  2021cited by this paper
• On the Opportunities and Risks of Foundation Models

  2021cited by this paper
• Finetuned Language Models Are Zero-Shot Learners

  2021cited by this paper
• A survey on unsupervised domain adaptation in computer vision tasks

  2021cited by this paper
• Multi-constraint molecular generation based on conditional transformer, knowledge distillation and reinforcement learning

  2021cited by this paper
• RetGen: A Joint Framework for Retrieval and Grounded Text Generation Modeling

  2021cited by this paper
• Learning to Compare for Better Training and Evaluation of Open Domain Natural Language Generation Models

  2020cited by this paper
• Pre-trained models for natural language processing: A survey

  2020cited by this paper
• Monocular depth estimation based on deep learning: An overview

  2020cited by this paper
• A Primer in BERTology: What We Know About How BERT Works

  2020cited by this paper
• REALM: Retrieval-Augmented Language Model Pre-Training

  2020cited by this paper
• Compressing BERT: Studying the Effects of Weight Pruning on Transfer Learning

  2020cited by this paper
• A Survey on Knowledge Graphs: Representation, Acquisition, and Applications

  2020cited by this paper
• Scaling Laws for Neural Language Models

  2020cited by this paper
• MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices

  2020cited by this paper
• Learning To Navigate The Synthetically Accessible Chemical Space Using Reinforcement Learning

  2020cited by this paper
• First return, then explore

  2020cited by this paper
• Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

  2020cited by this paper
• Language Models are Few-Shot Learners

  2020cited by this paper
• The Lottery Ticket Hypothesis for Pre-trained BERT Networks

  2020cited by this paper
• Learning to summarize from human feedback

  2020cited by this paper
• BinaryBERT: Pushing the Limit of BERT Quantization

  2020cited by this paper
• Grandmaster level in StarCraft II using multi-agent reinforcement learning

  2019cited by this paper
• Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer

  2019cited by this paper
• Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT

  2019cited by this paper
• Patient Knowledge Distillation for BERT Model Compression

  2019cited by this paper
• RoBERTa: A Robustly Optimized BERT Pretraining Approach

  2019cited by this paper
• Pre-Training with Whole Word Masking for Chinese BERT

  2019cited by this paper
• Language Models are Unsupervised Multitask Learners

  2019cited by this paper
• A Comprehensive Comparison of Unsupervised Network Representation Learning Methods

  2019cited by this paper
• BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

  2019cited by this paper
• Generalizing from a Few Examples

  2019cited by this paper
• BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension

  2019influential reference
• DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter

  2019cited by this paper
• ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

  2019cited by this paper
• TinyBERT: Distilling BERT for Natural Language Understanding

  2019cited by this paper
• K-BERT: Enabling Language Representation with Knowledge Graph

  2019cited by this paper
• Finding Generalizable Evidence by Learning to Convince Q&A Models

  2019cited by this paper
• Reinforcement learning - an introduction, 2nd Edition

  2018cited by this paper
• Addressing Function Approximation Error in Actor-Critic Methods

  2018influential reference
• Deep Contextualized Word Representations

  2018cited by this paper
• Improving Language Understanding by Generative Pre-Training

  2018influential reference

• How does generative AI impact the platforms’ competition strategies? The effects of human-AI interaction and human feedback

  2026cites this paper
• A MoE-LLM-based multisensor flexible fusion fault diagnosis method for rotating machinery

  2026cites this paper
• Multi-Scale Mixture-of-Experts ControlNet for Real-World Movie Scene Image Super-Resolution

  2026cites this paper
• Positional-aware Spatio-Temporal Network for Large-Scale Traffic Prediction

  2026cites this paper
• Implementation and Intelligent Path Exploration of Multimodal Large Model Architecture for Open-Pit Coal Mine Production

  2026cites this paper
• CTFAgent: An LLM-powered Agent for CTF Challenge Solving

  2026cites this paper
• Longitudinal Insights into AI in Education: Usage, Ethics, and Policy Development in Higher Education

  2026cites this paper
• Chatbots in Multivariable Calculus Exams: Innovative Tool or Academic Risk?

  2026cites this paper
• Utility of ChatGPT-4o in Creating Patient Handouts in Ophthalmology: A Comparison With American Academy of Ophthalmology Educational Materials

  2026cites this paper
• The new wave of generative artificial intelligence in medical education

  2026cites this paper
• Psychological engagement with automated design improvement feedback: a multiple case study of ChatGPT in design education.

  2026cites this paper
• Adopting GenAI applications in the workplace: managerial implications and insights from ICT professionals

  2026cites this paper
• Leveraging fine-tuning of large language models for aspect-based sentiment analysis in resource-scarce environments

  2026cites this paper
• GPT Agent-Supported Edge Intelligence for Optimizing D2D Communications

  2026cites this paper
• The Power of Small LLMs: A Multi-Agent for Code Generation via Dynamic Precaution Tuning

  2026cites this paper
• A deep energy method for solid mechanics based on a generalized multiplier approach

  2026cites this paper
• A Comparative Evaluation of GPT-4 Turbo and Gemini-Pro in Medical Licensing Exams: Enhancing Artificial Intelligence's Role in Medical Education

  2026cites this paper
• From-Scratch Dexterous Grasp Type Annotation with SAM and Lightweight Vision-Language Models

  2026cites this paper
• The study of a novel topology-optimized heat sink for single-phase immersion cooling in data centers

  2026cites this paper
• Analysis of public opinions on natural disasters on short-video social media based on the Latent Dirichlet Allocation and prompt-BERT-TextCNN models

  2026cites this paper
• Generative artificial intelligence in healthcare: a bibliometric analysis.

  2026cites this paper
• Navigating Ethical Considerations and Implications of AI Chatbots in Higher Education: A Systematic Review

  2026cites this paper
• Revolutionizing sentiment analysis with generative AI: techniques, trends, and challenges

  2026cites this paper
• Visual information identification and Q&A of intangible cultural heritage inheritors by using enhanced Graph-Retrieval framework

  2026cites this paper
• Reality Copilot: Voice-First Human-AI Collaboration in Mixed Reality Using Large Multimodal Models

  2026influential citation
• When control meets large language models: From words to dynamics

  2026cites this paper
• Large language models in human-robot collaboration: A systematic review, trends, and challenges

  2026cites this paper
• Sherry: Hardware-Efficient 1.25-Bit Ternary Quantization via Fine-grained Sparsification

  2026cites this paper
• Evaluating AI chatbots in neurological function test interpretation for brain tumor surgery

  2026cites this paper
• In-Context Reinforcement Learning From Suboptimal Historical Data

  2026cites this paper
• Enhancing aero-engine blade few-shot anomaly detection with visual-language multi-modal models under domain shift conditions

  2026cites this paper
• Global evolution of ecosystem services research in watersheds: Insights from large language models

  2026cites this paper
• BAP-PR: Boundary-aware prompting progressive reasoning for few-shot named entity recognition

  2026cites this paper
• Enhancing Few-Shot Surface Defect Recognition via Pre-Trained Large Generative Models

  2026cites this paper
• Experience and Adaptation in AI-mediated Hiring Systems: A Combined Analysis of Online Discourse and Interface Design

  2026cites this paper
• Mico: efficient query scheduling for multi-cloud deployed LLM inference service

  2026cites this paper
• Cooperative task scheduling and resource allocation of embodied multi-satellite systems: AI-driven perspective

  2026influential citation
• Myth, reality, or in between: Unveiling potential geographical biases of ChatGPT

  2026cites this paper
• Artificial intelligence in microplastics domain: Current progress, challenges, and sustainable prospects.

  2026cites this paper
• Evaluating AI-Generated Geriatric Case Studies for Interprofessional Education: Systematic Analysis Across 5 Platforms

  2026cites this paper
• SOGPTSpotter: Detecting ChatGPT-Generated Answers on Stack Overflow

  2026cites this paper
• Afghan lecturers’ awareness, application, and concerns on ChatGPT integration in higher education

  2026cites this paper
• Supporting Peer-to-Peer Learning with LLMs: Investigating Smarter Student Solution Recommendations

  2026cites this paper
• Enhancing news classification: domain-specific guided pretraining based on adaptive selective masking

  2026cites this paper
• Three-dimensional facility layout optimization using large language model-driven A-star and non-dominated sorting genetic Algorithm-II

  2026cites this paper
• Optimizing medical image analysis with prompt-guided pseudo-labeling

  2026cites this paper
• Document modelling using topics based on meaningful-interesting patterns for information filtering

  2026cites this paper
• Revisiting the Role of Linguistic Knowledge in Large Language Models through Prompting

  2026cites this paper
• Real-time intelligent virtual assistant based on retrieval augmented generation

  2026cites this paper
• Self-supervised vision transformers for classification in unconventional shales

  2026cites this paper
• Trust and overreliance on ChatGPT and its implications on critical thinking: an exploration in health policy

  2026cites this paper
• Engaging Artificial Intelligence (AI)-based chatbots in digital health: A systematic review

  2026cites this paper
• Explainable classifier with adaptive optimisation for medical data

  2026cites this paper
• Power system operational reliability evaluation with retrieval-augmented generation enhanced large language model

  2026cites this paper
• SIPA: a self-iterative preference alignment method for generative language models

  2026cites this paper
• Uncertainty-aware variational soft prompt for few-shot tuning in fMRI-based mental state decoding

  2026cites this paper
• Transforming E-Business with Artificial Intelligence: Insights, Impacts, and Emerging Trends

  2026cites this paper
• From surface to substance: Experiential learning to promote understanding of ChatGPT for K-12 lesson planning

  2026cites this paper
• How Human is AI? Examining the Impact of Emotional Prompts on Artificial and Human and Responsiveness

  2026cites this paper
• The effectiveness of multilingual AI-based simulator for suicide risk assessment training in improving self-efficacy among young psychiatrists: a pilot study across twenty languages

  2026cites this paper
• Talking Technology Tutors: The Perceptions of Conversational AI in Education through the Eyes of Parents and Teachers Worldwide

  2026cites this paper
• AutoFPDesigner: Automated Flight Procedure Design Based on Multi-Agent Large Language Model

  2026cites this paper
• Probing AR-assisted seamless HRC assembly for industry 5.0: Multi-modal mutual cognition and LLM-driven knowledge reasoning

  2026cites this paper
• Quantum artificial intelligence: A survey

  2026cites this paper
• Personalized safety training for construction workers: A large language model-driven multi-agent framework integrated with knowledge graph reasoning

  2026cites this paper
• Unveiling and Causalizing CoT: A Causal Pespective

  2025cites this paper
• CoRe: Coherency Regularization for Hierarchical Time Series

  2025cites this paper
• Applying Large Language Model Analysis and Backend Web Services in Regulatory Technologies for Continuous Compliance Checks

  2025cites this paper
• Integrating Domain Knowledge into Large Language Models for Enhanced Fashion Recommendations

  2025cites this paper
• A Transformer-based method to simulate multi-scale soil moisture

  2025cites this paper
• AIvaluateXR: An Evaluation Framework for on-Device AI in XR with Benchmarking Results

  2025cites this paper
• A Survey of Zero-Knowledge Proof Based Verifiable Machine Learning

  2025cites this paper
• Dehumanizing Machines: Mitigating Anthropomorphic Behaviors in Text Generation Systems

  2025cites this paper
• DiffractGPT: Atomic Structure Determination from X-ray Diffraction Patterns Using a Generative Pretrained Transformer

  2025influential citation
• NeuRL: A Standalone No-Code Web-Based Agent Environment to Explore Neural Networks and Reinforcement Learning

  2025cites this paper
• AI and the Law: Evaluating ChatGPT's Performance in Legal Classification

  2025cites this paper
• Mapping the evolution of GPT-4o innovations: An analytical exploration of progress, applications, and horizons

  2025cites this paper
• Assessing the Influence of ChatGPT on Student Outcomes in a Models of Computing Course

  2025cites this paper
• Can ChatGPT Learn to Count Letters?

  2025cites this paper
• Combining SAM With Limited Data for Change Detection in Remote Sensing

  2025cites this paper
• AI chatbots with visual search: Impact on luxury fashion shopping behavior

  2025cites this paper
• Evaluating large language models for surgical chart review of second stage implant-based breast reconstruction: a comparative analysis of manual review, GPT-3.5 Turbo, and GPT-4 Turbo

  2025cites this paper
• Generative AI for Internet of Things Security: Challenges and Opportunities

  2025cites this paper
• Achieving adaptive tasks from human instructions for robots using large language models and behavior trees

  2025cites this paper
• The role of GPT in promoting inclusive higher education for people with various learning disabilities: a review

  2025cites this paper
• Exploring influencing factors of health resilience for urban buildings by integrated CHATGPT-empowered BERTopic model: A case study of Hong Kong

  2025cites this paper
• A systematic literature review to implement large language model in higher education: issues and solutions

  2025cites this paper
• Automated and code-free development of a risk calculator using ChatGPT-4 for predicting diabetic retinopathy and macular edema without retinal imaging

  2025cites this paper
• Attitude Mining Toward Generative Artificial Intelligence in Education: The Challenges and Responses for Sustainable Development in Education

  2025cites this paper
• An Investigation of Using ChatGPT to Personalize Student’s Learning Process in EFL Writing Classes

  2025cites this paper
• From tools to thieves: Measuring and understanding public perceptions of AI through crowdsourced metaphors

  2025cites this paper
• MDEval: Evaluating and Enhancing Markdown Awareness in Large Language Models

  2025cites this paper
• Diffusion Augmented Retrieval: A Training-Free Approach to Interactive Text-to-Image Retrieval

  2025cites this paper
• Understanding Attitudes and Trust of Generative AI Chatbots for Social Anxiety Support

  2025cites this paper
• A Multifaceted Vision of the Human-AI Collaboration: A Comprehensive Review

  2025influential citation
• Higher education students’ perceptions of ChatGPT: A global study of early reactions

  2025cites this paper
• MAST: Multiagent Safe Transformer for Reinforcement Learning

  2025cites this paper
• Effective prompting with ChatGPT for problem formulation in engineering optimization

  2025influential citation
• Understanding ChatGPT: Impact Analysis and Path Forward for Teaching Computer Science and Engineering

  2025cites this paper
• Academic Staff Perspectives on the Impact of Artificial Intelligence on Pharmaceutical Sciences Research and Writing: A Qualitative Study.

  2025cites this paper