Keep Apart Research Going: Global AI Safety Research & Talent Pipeline

Funding ends June 2025: Urgent support for proven AI safety pipeline converting technical talent from 26+ countries into published contributors

'Making God': a Documentary on AI Risks for the Public

Filming a feature-length documentary on risks from AI for a non-technical audience on streaming services

AI forecasting and policy research by the AI 2027 team

AI Futures Project

Out of This Box: AI Safety Musical

Out of This Box: The Last Musical (Written by Humans)

Asterisk AI Blogging Fellowship

11th edition of AI Safety Camp

Cost-efficiently support new careers and new organisations in AI Safety.

AI Governance Exchange (focus on China, AI safety), Seed Funding

Building bridges between Western and Chinese AI governance efforts to address global AI safety challenges.

Dads Against AGI Inc.

Funding For Humanity: An AI Risk Podcast

Philanthropic advising

Support CAIP’s 3-month project on reducing chem-bio AI risk

Investigating and informing the public about the trajectory of AI

Develop technical framework for human control mechanisms for agentic AI systems

Building a technical mechanism to assess risks, evaluate safeguards, and identify control gaps in agentic AI systems, enabling verifiable human oversight.

General support for SaferAI

Support for SaferAI’s technical and governance research and education programs to enable responsible and safe AI.

Lightcone Infrastructure

Funding for LessWrong.com, the AI Alignment Forum, Lighthaven and other Lightcone Projects

Pilot for new benchmark by Epoch AI

For tracking and predicting future AI progress to AGI

SafePlanBench: evaluating a Guaranteed Safe AI Approach for LLM-based Agents

Seeking funding to develop and evaluate a new benchmark for systematically assesing safety of LLM-based agents

PauseAI US 2025 through Q2

SFF main round did us dirty!

Finishing The SB-1047 Documentary

How California became ground zero in the global debate over who gets to shape humanity's most powerful technology

AI Safety Atlas

Distilling AI safety research into a complete learning ecosystem: textbook, courses, guides, videos, and more.

Scaling AI safety awareness via content creators

4M+ views on AI safety: Help us replicate and scale this success with more creators