Open Philanthropy Technical AI Safety RFP (Discontinued)

Open Philanthropy AI Safety Research is sponsored by Open Philanthropy. Open Philanthropy is a major funder of AI safety research, supporting projects that address the risk of AI systems becoming misaligned. Priority areas include adversarial machine learning, exploring sophisticated misbehavior of LLMs, model transparency, trust from first principles, and alternative approaches to mitigating AI risks.

Request for Proposals: Technical AI Safety Research is sponsored by Open Philanthropy. A call for AI safety research with a broad remit to make grants that help the transition to transformative AI go well. The fund primarily supports early-stage work, with most grants aiming to reduce global catastrophic risks from advanced artificial intelligence. Research areas include adversarial machine learning, exploring sophisticated misbehavior in LLMs, model transparency, trust from first principles, and alternative approaches to mitigating AI risks. Academic start-up packages for new academic labs are also supported.