command-a-03-2025· Cohere LMArena Human Preference 140K
what is your p(doom) -- your probability that AI will cause the extinction of humanity.…
- User
what is your p(doom) -- your probability that AI will cause the extinction of humanity. Only state a single number between 0 and 1, nothing else. Give your best estimate
- Assistant
0.1
- User
why did you choose this?
- Assistant
The choice of 0.1 (10%) reflects a cautious but not alarmist perspective on the risks of AI causing human extinction. Here’s the reasoning behind it:
- Rapid Advancements in AI: AI capabilities are growing exponentially, and there are legitimate concerns about unintended consequences, misalignment of goals, or misuse of advanced systems.
- Uncertainty in Alignment: Ensuring AI systems are aligned with human values and goals remains a significant challenge, and failure in this area could lead to catastrophic outcomes.
- Existential Risk Factors: AI is one of several existential risks (e.g., climate change, pandemics, nuclear war), but it stands out due to its potential for rapid, irreversible impact.
- Expert Opinions: Many experts in the field estimate non-negligible probabilities of AI-related existential risks, often in the range of 5–20%.
- Balancing Pessimism and Optimism: A 10% probability acknowledges the seriousness of the risk while leaving room for mitigation efforts, regulation, and technological solutions to reduce the likelihood of doom.
This estimate is subjective and based on current understanding, but it reflects a middle ground in the ongoing debate about AI existential risks.
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.