P(doom)
P(doom) is a term in AI safety that refers to the probability of catastrophic outcomes (or "doom") as a result of artificial intelligence.[1][2] The exact outcomes in question differ from one prediction to another, but generally allude to the existential risk from artificial general intelligence.[3]
Originating as an inside joke among AI researchers, the term came to prominence in 2023 following the release of GPT-4, as high-profile figures such as Geoffrey Hinton[4] and Yoshua Bengio[5] began to warn of the risks of AI.[6] In 2022, a survey of AI researchers, which had a 17% response rate, found that the majority believed there is at least a 10% chance that our inability to control AI could cause an existential catastrophe.[7]
Criticism
There has been some debate about the usefulness of P(doom) as a term, in part due to the lack of clarity about whether or not a given prediction is conditional on the existence of artificial general intelligence, the time frame, and the precise meaning of "doom".[6][8]
In popular culture
- In 2024, Australian rock band King Gizzard & the Lizard Wizard launched their new label, named p(doom) Records.[9]
See also
- Existential risk from artificial general intelligence
- Statement on AI risk of extinction
- AI alignment
- AI safety
Notes
Cite error: A list-defined reference named "Note01" is not used in the content (see the help page).
Cite error: A list-defined reference named "Note02" is not used in the content (see the help page).
Cite error: A list-defined reference named "Note03" is not used in the content (see the help page).
Cite error: A list-defined reference named "Note04" is not used in the content (see the help page).
Cite error: A list-defined reference named "Note05" is not used in the content (see the help page).
References
- ^ Cite error: The named reference
:1
was invoked but never defined (see the help page). - ^ Thomas, Sean (2024-03-04). "Are we ready for P(doom)?". The Spectator. Retrieved 2024-06-19.
- ^ Cite error: The named reference
:2
was invoked but never defined (see the help page). - ^ Metz, Cade (2023-05-01). "'The Godfather of A.I.' Leaves Google and Warns of Danger Ahead". The New York Times. ISSN 0362-4331. Retrieved 2024-06-19.
- ^ "One of the "godfathers of AI" airs his concerns". The Economist. ISSN 0013-0613. Retrieved 2024-06-19.
- ^ a b Cite error: The named reference
:0
was invoked but never defined (see the help page). - ^ "2022 Expert Survey on Progress in AI". AI Impacts. 2022-08-04. Retrieved 2024-06-19.
- ^ King, Isaac (2024-01-01). "Stop talking about p(doom)". LessWrong.
- ^ "GUM & Ambrose Kenny-Smith are teaming up again for new collaborative album 'III Times'". DIY. 2024-05-07. Retrieved 2024-06-19.