Foundation model
Foundational models" refers to artificial intelligence models trained on vast quantity of data at scale resulting in major transformations of how AI systems are built, with the potential of major consequences for society. societal consequences."[1] Examples of foundational models include BERT,[2] GPT-3, CLIP, and Codex.[3]
An early iteration of a foundational model was found in I. J. Good's 1965 treatise entitled "Speculations Concerning the First Ultraintelligent Machine"[4][5] Stanley Kubrick's HAL 9000 supercomputer in his 1968 2001: A Space Odyssey was modelled after Good's ultraintelligent machine.[6]
References
- ^ "Introducing the Center for Research on Foundation Models (CRFM)". Stanford HAI. Retrieved 11 June 2022.
- ^ Rogers, Anna; Kovaleva, Olga; Rumshisky, Anna (2020). "A Primer in BERTology: What we know about how BERT works". arXiv:2002.12327 [cs.CL].
- ^ "Introducing the Center for Research on Foundation Models (CRFM)". Stanford HAI. Retrieved 11 June 2022.
- ^ "Huge "foundation models" are turbo-charging AI progress". The Economist. 11 June 2022. ISSN 0013-0613. Retrieved 11 June 2022.
- ^ Good, I.J. (1965), Speculations Concerning the First Ultraintelligent Machine
- ^ Dan van der Vat (29 April 2009), ""Jack Good" (obituary)", The Guardian, p. 32, retrieved 9 October 2013
Differentiable computing | |
|---|---|
| General | |
| Hardware | |
| Software libraries | |
| |
