EA - Launching Foresight Institute's AI Grant for Underexplored Approaches to AI Safety - Apply for Funding! by elteerkers

Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Launching Foresight Institute's AI Grant for Underexplored Approaches to AI Safety - Apply for Funding!, published by elteerkers on August 19, 2023 on The Effective Altruism Forum.SummaryWe are excited to launch our new grant programme that will fund areas that we consider underexplored when it comes to AI safety. In light of the potential for shorter AGI timelines, we will re-grant $1-1.2 million per year to support much needed development in one of the following areas:Neurotechnology, Whole Brain Emulation, and Lo-fi uploading for AI safetyCryptography and Security approaches for Infosec and AI securitySafe Multipolar AI scenarios and Multi-Agent gamesApply for funding- to be reviewed on a rolling basis.See below, or visit our website to learn more!Areas that We're Excited to FundNeurotechnology, Whole Brain Emulation, and Lo-fi uploading for AI safetyWe are interested in exploring the potential of neurotechnology, particularly Whole Brain Emulation (WBE) and cost-effective lo-fi approaches to uploading, that could be significantly sped up, leading to a re-ordering of technology arrival that might reduce the risk of unaligned AGI by the presence of aligned software intelligence.We are particularly excited by the following:WBE as a potential technology that may generate software intelligence that is human-aligned simply by being based directly on human brainsLo-fi approaches to uploading (e.g. extensive lifetime video of a laboratory mouse to train a model of a mouse without referring to biological brain data)Neuroscience and neurotech approaches to AI Safety (e.g. BCI development for AI safety)Other concrete approaches in this areaGeneral scoping/mapping opportunities in this area, especially from a differential technology development perspective, as well as understanding the reasons why this area may not be a suitable focusCryptography and Security approaches for Infosec and AI securityTo explore the potential benefits of Cryptography and Security technologies in securing AI systems. This includes:Computer security to help with AI Infosecurity or approaches for scaling up security techniques to potentially apply to more advanced AI systemsCryptographic and auxiliary techniques for building coordination/governance architectures across different AI(-building) entitiesPrivacy-preserving verification/evaluation techniquesOther concrete approaches in this areaGeneral scoping/mapping opportunities in this area, especially from a differential technology development perspective, or exploring why this area is not a good focus areaSafe Multipolar AI scenarios and Multi-Agent gamesExploring the potential of safe Multipolar AI scenarios, such as:Multi-agent game simulations or game theoryScenarios avoiding collusion and deception, and pareto-preferred and positive-sum dynamicsApproaches for tackling principal agent problems in multipolar systemsOther concrete approaches in this areaGeneral scoping/mapping opportunities in this area, especially from a differential technology development perspective, or exploring why this area is not a good focus areaInterested in Applying?We look forward to receiving your submissions. Applications will be reviewed on a rolling basis-apply here.For the initial application, you'll be required to submit:A background of yourself and your workA short summary and budget for your project highlighting which area you are applying to, and outlining what you would like to investigate and whyAt least two referencesWe will aim to get back to applicants within 8 weeks of receiving their application.If you are interested then please find more information about the grant here.Thanks for listening. To help us out with The Nonlinear Library or to learn more, please visit nonlinear.org