GPT-2
OpenAI published a description of GPT-2.
Why it matters
It showed how a large Transformer could generate coherent continuations from prompts.
OpenAI’s publication also discusses release risks and staged sharing.
Research · February 2019
Event record
- Event date
- February 2019
- Timeline date
- Event date
- Verification
- Sources gathered automatically · September 11, 2026
- Lines
- ID
- evt-0013
Sources
- primary GPT-2
OpenAI · Published February 2019
Related events
- Builds on Transformer
The GPT-2 technical description identifies Transformer-based language modeling.
GPT-2
Records that link to this one
- Related Scaling laws
The study measured models of the same architectural family.
- Related ChatGPT
The assistant rests on the GPT line of language models.
- Enables GPT-1
The direct predecessor of GPT-2, eight months later.
Improving Language Understanding by Generative Pre-Training - Extends GPT-3
The same architecture, scaled up a hundredfold.
Language Models are Few-Shot Learners - Related gpt-oss
The company's first open weights since GPT-2 in 2019.
- Related California: a bot must say it is a bot
The law was passed five months before GPT-2 was described and is written about automated accounts, not language models; its disclosure duty also covers a bot running on such a model.