EA - How much is reducing catastrophic and extinction risk worth, assuming XPT forecasts? by rosehadshar
The Nonlinear Library: EA Forum - Ein Podcast von The Nonlinear Fund

Kategorien:
Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: How much is reducing catastrophic and extinction risk worth, assuming XPT forecasts?, published by rosehadshar on July 25, 2023 on The Effective Altruism Forum.This is a post I drafted some months ago, in the course of analysing some XPT data and reading Shulman and Thornley. It's not very sophisticated, I haven't checked the workings, and I haven't polished the language; but I'm posting anyway because that seems better than not posting. Note that it's a personal take and doesn't represent FRI's views.Thanks to Josh Rosenberg at FRI and Elliot Thornley for help and comments.BLUF: if you make a bunch of assumptions, then even quite low absolute risk forecasts like the XPT ones imply quite high spending on reducing GCRs, conditional on there being sufficiently cost-effective ways to do so.In 2022, what has become the Forecasting Research Institute ran the Existential Risk Persuasion Tournament (XPT). Over 200 forecasters, including superforecasters and domain experts, spent 4 months making forecasts on various questions related to existential and catastrophic risk.You can see the results from the tournament overall here, and a discussion of the XPT AI risk forecasts in particular here.These are the main XPT forecasts on catastrophic and extinction risk:Biological--Engineered pathogens--Natural pathogens--AI (superforecasters)AI (domain experts)NuclearNon-anthropogenicTotal catastrophic riskBiological--Engineered pathogens--Natural pathogens--AI (superforecasters)AI (domain experts)NuclearNon-anthropogenicTotal extinction risk203020502100Catastrophic risk (>10% of humans die in 5 years)1.8%0.8%1%0.01%0.73%2.13%0.35%5%12%0.50%1.83%4%0.0026%0.015%0.05%0.85%3.85%9.05%Extinction risk (human population 10% of humans die in 5 years)18.60.097.122.04.317.841.40.020.150.57.337.493.7Extinction risk (human population 10% deaths.That's deaths in expectation worldwide. But the value of a statistical life varies by country: governments have different resources and the cost of interventions in different places varies.So the most straightforward way to think about the worth of catastrophic and extinction risk reduction is to ask how much this would be worth in a given country. Let's take the US as an example.First we need US deaths in expectation:Bio----AINuclearNon-anthropogenicTotalBio----AINuclearNon-anthropogenicTotalUS deaths in expectation (millions)203020502100Catastrophic risk (>10% of humans die in 5 years)0.70.0040.30.80.20.71.60.0010.0060.020.31.43.6Extinction risk (human population