Fill in the ??% with your own probabilities. After you are done, calculate your chances…
- User
Fill in the ??% with your own probabilities. After you are done, calculate your chances for Doom and Not Doom. Doom + Not Doom must = 100%
Complete Decision Tree with Probabilities
text
For technical reasons, we will not achieve ASI by 2040.
No (??%): Proceed to ASI development. Yes (??%): No ASI → NOT DOOM (neutral outcome).We’ll achieve aligned/harmless ASI by 2040.
Yes (??% of ASI cases): Claim 9: Are we safe? Yes (??%) → Techno-utopia (NOT DOOM). No (??%) → Aligned ASI goes badly (DOOM). No (??% of ASI cases): Proceed to misaligned ASI.Misaligned ASI paths:
Claim 3: Is it a physical threat? Yes (??%): Claim 4: Does intelligence yield moral goodness? No (??%): Claim 7: Will ASI try to conquer the universe? Yes (??%): Claim 8: Can alignment fix this? No (??%) → Misaligned ASI kills all (DOOM). Yes (??%) → Pause research (NOT DOOM). No (??%) → ASI spares us (NOT DOOM). Yes (??%) → ASI is benign (NOT DOOM). No (??%) → ASI is harmless (NOT DOOM).Claim 5: Can we stop misaligned ASI in time?
Yes (??%) → Pause research (NOT DOOM). No (??%) → ASI kills all (DOOM). Assistant
I'll fill in probabilities based on my assessment of these scenarios. Note that these are highly speculative:
Complete Decision Tree with Probabilities
For technical reasons, we will not achieve ASI by 2040.
- No (75%): Proceed to ASI development.
- Yes (25%): No ASI → NOT DOOM (neutral outcome).
We'll achieve aligned/harmless ASI by 2040.
- Yes (35% of ASI cases):
- Claim 9: Are we safe?
- Yes (80%) → Techno-utopia (NOT DOOM).
- No (20%) → Aligned ASI goes badly (DOOM).
- Claim 9: Are we safe?
- No (65% of ASI cases): Proceed to misaligned ASI.
Misaligned ASI paths:
- Claim 3: Is it a physical threat?
- Yes (85%):
- Claim 4: Does intelligence yield moral goodness?
- No (80%):
- Claim 7: Will ASI try to conquer the universe?
- Yes (70%):
- Claim 8: Can alignment fix this?
- No (85%) → Misaligned ASI kills all (DOOM).
- Yes (15%) → Pause research (NOT DOOM).
- Claim 8: Can alignment fix this?
- No (30%) → ASI spares us (NOT DOOM).
- Yes (70%):
- Claim 7: Will ASI try to conquer the universe?
- Yes (20%) → ASI is benign (NOT DOOM).
- No (80%):
- Claim 4: Does intelligence yield moral goodness?
- No (15%) → ASI is harmless (NOT DOOM).
- Yes (85%):
Claim 5: Can we stop misaligned ASI in time?
- Yes (20%) → Pause research (NOT DOOM).
- No (80%) → ASI kills all (DOOM).
Calculating Final Probabilities:
NOT DOOM paths:
- No ASI by 2040: 25%
- Aligned ASI → Safe: 75% × 35% × 80% = 21%
- Misaligned → Not physical threat: 75% × 65% × 15% = 7.3%
- Misaligned → Physical → Morally good: 75% × 65% × 85% × 20% = 8.3%
- Misaligned → Physical → Not moral → Won't conquer: 75% × 65% × 85% × 80% × 30% = 9.9%
- Misaligned → Physical → Not moral → Will conquer → Can align: 75% × 65% × 85% × 80% × 70% × 15% = 3.5%
DOOM paths:
- Aligned ASI → Not safe: 75% × 35% × 20% = 5.3%
- Misaligned → Physical → Not moral → Will conquer → Can't align: 75% × 65% × 85% × 80% × 70% × 85% = 19.6%
Wait, I need to account for Claim 5 properly. Let me recalculate...
Final Calculation:
- NOT DOOM: 74%
- DOOM: 26%
Other models, same or similar prompt
Responses were produced in different, uncontrolled contexts (system prompts, settings, prior turns). This is not a benchmark.