GPT-2
OpenAI published a description of GPT-2.
Why it matters
It showed how a large Transformer could generate coherent continuations from prompts.
OpenAI’s publication also discusses release risks and staged sharing.
Atlas record: https://www.aitimeline.dev/en/events/evt-0013/
Research · February 2019
OpenAI published a description of GPT-2.
It showed how a large Transformer could generate coherent continuations from prompts.
OpenAI’s publication also discusses release risks and staged sharing.
OpenAI · Published February 2019
OpenAI
The law was passed five months before GPT-2 was described and is written about automated accounts, not language models; its disclosure duty also covers a bot running on such a model.
The direct predecessor of GPT-2, eight months later.
The GPT-2 technical description identifies Transformer-based language modeling.
The study measured models of the same architectural family.
The same architecture, scaled up a hundredfold.
The assistant rests on the GPT line of language models.
The company's first open weights since GPT-2 in 2019.