GPT-5

Generative Pre-trained Transformer 5 (GPT-5) is an unreleased multimodal large language model created by OpenAI, expected to be the fifth in its series of the OpenAI GPT foundation models. On July 18, 2023, OpenAI filed for the trademark “GPT-5” for classes 9 and 42.

Generative Pre-trained Transformer 5 (GPT-5)

Developer(s)	OpenAI
Initial release	Upcoming
Engine
Replaces	GPT-4
Type	Multimodal Large language model Generative pre-trained transformer Foundation model
License	Proprietary

Search GPT-5 on Amazon.

Part of a series on
Machine learning and data mining
Paradigms Supervised learning Unsupervised learning Online learning Batch learning Meta-learning Semi-supervised learning Self-supervised learning Reinforcement learning Rule-based learning Quantum machine learning
Problems Classification Generative model Regression Clustering dimension reduction density estimation Anomaly detection Data Cleaning AutoML Association rules Semantic analysis Structured prediction Feature engineering Feature learning Learning to rank Grammar induction Ontology learning Multimodal learning
Supervised learning (classification • regression) Apprenticeship learning Decision trees Ensembles Bagging Boosting Random forest k-NN Linear regression Naive Bayes Artificial neural networks Logistic regression Perceptron Relevance vector machine (RVM) Support vector machine (SVM)
Clustering BIRCH CURE Hierarchical k-means Fuzzy Expectation–maximization (EM) DBSCAN OPTICS Mean shift
Dimensionality reduction Factor analysis CCA ICA LDA NMF PCA PGD t-SNE SDL
Structured prediction Graphical models Bayes net Conditional random field Hidden Markov
Anomaly detection RANSAC k-NN Local outlier factor Isolation forest
Artificial neural network Autoencoder Cognitive computing Deep learning DeepDream Feedforward neural network Recurrent neural network LSTM GRU ESN reservoir computing Restricted Boltzmann machine GAN Diffusion model SOM Convolutional neural network U-Net Transformer Vision Mamba Spiking neural network Memtransistor Electrochemical RAM (ECRAM)
Reinforcement learning Q-learning SARSA Temporal difference (TD) Multi-agent Self-play
Learning with humans Active learning Crowdsourcing Human-in-the-loop
Model diagnostics Learning curve
Mathematical foundations Kernel machines Bias–variance tradeoff Computational learning theory Empirical risk minimization Occam learning PAC learning Statistical learning VC theory
Machine-learning venues ECML PKDD NeurIPS ICML ICLR IJCAI ML JMLR
Related articles Glossary of artificial intelligence List of datasets for machine-learning research List of datasets in computer vision and image processing Outline of machine learning

Background

Further information: GPT-4 § Background, GPT-3 § Background, and GPT-2 § Background

OpenAI introduced the first GPT model (GPT-1) in 2018, publishing a paper called Improving Language Understanding by Generative Pre-Training. It was based on the transformer architecture and trained on a large corpus of books. In 2019, they introduced GPT-2, a larger model that could generate coherent text.

In 2020, they introduced GPT-3, a model with 100 times as many parameters as GPT-2, that could perform various tasks with few examples. GPT-3 was further improved into InstructGPT, which was used to create the chatbot product ChatGPT. ChatGPT now uses GPT-3.5 for free users and GPT-4, which was released on March 14, 2023, for Plus users.

GPT-4 partially or fully powers many applications, including but not limited to Microsoft Copilot, GitHub Copilot, Snapchat, Khan Academy, and Duolingo.

Timeline

3/8/2023: OpenAI releases GPT-4, its most powerful language model to date.

April 14, 2023: OpenAI CEO Sam Altman speaks at an event at MIT and confirms that the company is not currently training GPT-5. He says that OpenAI is "prioritizing GPT-4 development" and that "we are not and won't for some time" release GPT-5.

July 18, 2023: OpenAI filed for the Trademark GPT-5 for classes 9 and 42. UPSTO serial number 98089548.

November 13, 2023: Altman told the Financial Times that the company is now working to develop GPT-5

Release date

There is no official release date for GPT-5 yet. Some sources suggested a release as early as 2023, but GPT-5 did not release that year. A release in 2025 or later has also been speculated.

Features

GPT-5 is expected to be a major improvement over GPT-4. Here is some information about the features of GPT-5:

Architecture

GPT-5 may use an advanced architecture that allows it to process and generate language more efficiently and accurately than previous versions. This architecture may include graph neural networks and attention mechanisms, which help the model to better understand the relationships between words and phrases.

Artificial General Intelligence

GPT-5 may be able to achieve artificial general intelligence, the hypothetical level of intelligence which OpenAI defines as the ability to perform any economically valuable task that a human can. Some reports claimed that OpenAI expected GPT-5 to achieve AGI by the end of 2023.

Challenges

Negative reputation

GPT-5 may face pushback from the tech community and the public, as some people fear the potential dangers and ethical issues of AI. Some notable personalities, such as Elon Musk and Steve Wozniak, have warned about the risks of AI and called for a pause on training models more advanced than GPT-4. They also suggested that tech giants should cooperate rather than compete in the AI field.

Limited availability

GPT-5 may not be available to everyone, as OpenAI may limit its access to ChatGPT Plus subscribers and Bing Chat beta testers, which they have already done with GPT-4.

References

Template:OpenAI navbox

This article "GPT-5" is from Wikipedia. The list of its authors can be seen in its historical and/or the page Edithistory:GPT-5. Articles copied from Draft Namespace on Wikipedia could be seen on the Draft Namespace of Wikipedia and not main one.

---