Exploratory Grants in AI Safety is sponsored by Lightspeed Grants. Funds fast, early-stage projects aimed at helping humanity avoid existential catastrophe from advanced AI.

This is a draft, please don't share yet. Fast funding for projects that help humanity flourish among the stars We are distributing $5,000,000 to projects that make a difference to humanity's future light cone. Apply [Applications are closed] We are looking for projects that have a chance of substantially changing humanity's future trajectory for the better.

The areas in which this kind of change seems most likely to us are: Reducing the probability of existential catastrophe from Artificial Intelligence Preventing the development or propagation of novel biological pathogens Improving the reasoning of key global decisionmakers Uncovering crucial considerations that could shift our understanding of the future Applications that fall outside of these focus areas are still welcome, and we expect to fund a substantial number of projects that don't narrowly fall into any of the categories above.

For more information, discussion and detail see also our LessWrong launch post. How does the Lightspeed Grants process work? The basic goal of the process is to allow multiple funders to coordinate on funding decisions, while maintaining maximum freedom for each funder to fund whatever projects they are excited about.

The process works as follows: Every grant evaluator decides how much value each project creates at various funding levels. Funders review the evaluator's reasoning. We find an allocation of funds that’s fair and maximizes the funders’ and evaluators’ expressed preferences (using a number of somewhat dubious but probably not too terrible assumptions).

Funders can adjust how much money they want to distribute after seeing everyone’s evaluations, including fully pulling out. We've been doing various forms of grantmaking for many years, being involved in many grantmaking projects like the Survival and Flourishing Fund and the Long Term Future Fund and we think we can do better, both in grant quality and applicant-experience.

In our experience of running projects aiming to reduce existential risk from AI, we've also found that speed is a key variable that often makes or breaks a project. Waiting on funding, and funding uncertainty, is often the key breaking point for a project. We aim to do better.

If you are a funder interested in funding applications to Lightspeed Grants, or want to more broadly use our process, send us an email at funds@lightspeedgrants. org and we will get back to you in 24 hours. Community forum dedicated to the Art of Rationality Bell Labs for longtermism Mechanism design for philanthropic coordination Build a hub for making intellectual progress online.

Work backwards in an intensely collaborative team. Write functional code to solve mechanism design problems. Lightspeed grants is run by Lightcone Infrastructure .

Applications are evaluated by grant-evaluators selected for their general reasoning ability and networks to people doing promising work and are chosen by us in collaboration with our funders. Our primary funder for this round is Jaan Tallinn. Fiscal sponsorship for successful applications is provided by EA Funds .