
Builds and runs evaluations that measure whether frontier AI systems can carry out long, autonomous tasks.

Researches the trajectory of AI: compute, training data, benchmarks and economic impact.

Researches how to stay safe from AI systems that might act against their developers, known as AI control.

A research and training program pairing emerging AI safety researchers with mentors.

Does technical AI safety research, and runs workshops and a coworking space for the field.

Runs programs that bring people into AI safety: SPAR research mentorship, and Pathfinder for university groups.

Researches how to govern advanced AI, advises governments and labs, and trains people for AI governance careers.

Warns policymakers and the public about the danger of superhuman AI, and researches how to govern it.

Advises major donors and runs funds for reducing risks from AI, nuclear weapons and pandemics.

A think tank researching policy for advanced AI, with a fellowship for people entering the field.

We build beautiful infrastructure for truth-seeking and world-saving

Runs courses on AI safety, AI governance and biosecurity, and helps graduates into work on them.

Runs a research center in Berkeley for people working on AI safety, with fellowships and an incubator.

Research, field-building and advocacy to reduce societal-scale risks from AI.

Ensure that AI oversight scales with AI capabilities

Builds interactive explainers and demos of AI (AI Digest, the AI Village) and forecasting tools like Fatebook.

Advocates for challenge-trial volunteers and for faster development of vaccines and treatments.

Studies what the latest AI systems can do and how they behave, and shows the results to policymakers and the public.

Theoretical research on aligning future machine learning systems with human interests.

A small research group forecasting the future of AI; the authors of AI 2027.

Navigate the transition to a world with superintelligent AI systems

A coworking & events space in SF for AI safety, AI labs, EA charities & startups