GenerativePretrainedTransformer

ThoughtStorms Wiki

Context ArtificialIntelligence / LanguageModels / NeuralNetworks / Transformers

Probably the world's most famous LanguageModel or Transformer.

Currently at version GPT4.

Available through ChatGPT (which is how I'm mainly using it)

Writes code pretty well.

LanguageModelApps

LanguageModelAgents

Historic

https://garymarcus.substack.com/p/how-come-gpt-can-seem-so-brilliant?r=n4jg1

TheGuardian has it write an article https://www.theguardian.com/commentisfree/2020/sep/08/robot-wrote-this-article-gpt-3

https://nesslabs.com/gpt-3-future-productivity (Compare Psionica)

Play with GPT2

https://github.com/openai/gpt-2/blob/master/src/model.py

See also HuggingFace

https://arxiv.org/pdf/2005.14165.pdf

https://towardsdatascience.com/what-does-gpt-3-mean-for-ai-58cd66616051

Outperformed by new technique with soft supervision.

https://www.infoq.com/news/2020/10/training-exceeds-gpt3/

https://thenextweb.com/neural/2020/09/21/ai-devs-created-a-lean-mean-gpt-3-beating-machine-that-uses-99-9-fewer-parameters/

https://readwrite.com/2021/08/20/how-gpt-3-and-artificial-intelligence-will-destroy-the-internet/?__cf_chl_jschl_tk__=pmd_5ea464ace8adbc0ef424e317b988a37c0a1ca369-1629726779-0-gqNtZGzNAnijcnBszQcO

Backlinks (14 items)