# GPT-1

> generative pre-trained transformer-based language model from 2018

**Wikidata**: [Q95726718](https://www.wikidata.org/wiki/Q95726718)  
**Wikipedia**: [English](https://en.wikipedia.org/wiki/GPT-1)  
**Source**: https://4ort.xyz/entity/gpt-1


## References

1. [Source](https://huggingface.co/transformers/pretrained_models.html)
2. [Source](https://api.github.com/repos/openai/finetune-transformer-lm)
3. [Source](https://www.makeuseof.com/gpt-models-explained-and-compared/)
4. Improving Language Understanding by Generative Pre-Training
5. [Source](https://openai.com/blog/language-unsupervised/)