Graduate Training for AI Governance and Long-Term Risk Reduction.

Building early-career capacity to reduce AI-driven societal and catastrophic risks through focused graduate study.

Public Food Procurement as a Climate Policy Tool in the EU

Assessing the Climate Potential of Catering Systems in Public Schools and Hospitals

Paper Clip Apocalypse (War Horse Machine)

Short Documentary and Music Video

Terminal Boundary Systems and the Limits of Self-Explanation

Formalizing the "Safety Ceiling": An Agda-Verified Impossibility Theorem for AI Alignment

Mitigating Systemic Risks of Unchecked AI Deployment

A field-led policy inquiry using Nigeria’s MSME ecosystem as a global stress-test for Agentic AI governance.

Learn & Launch: Monthly Training and Mentorship for Early-Stage AI Safety & Gov.

A low-cost, high-leverage capacity-building program for early-career AI safety and governance practitioners

Evitable: a new public-facing AI risk non-profit

Our mission is to inform and organize the public to confront societal-scale risks of AI, and put an end to the reckless race to develop superintelligent AI.

Forethought

Research on how to navigate the transition to a world with superintelligent AI systems

Reducing Risk in AI Safety Through Expanding Capacity.

Testing a Deterministic Safety Layer for Agentic AI (QGI Prototype)

A prototype safety engine designed to relieve the growing AI governance bottleneck created by the EU AI Act and global compliance demands.

AI Security Startup Accelerator Batch #2

Funding 5–10 AI security startups through Seldon’s second SF cohort.

Addressing Agentic AI Risks Induced by System Level Misalignment

AI Safety Camp 2026 project: Bidirectional Failure modes between security and safety

Offensive Cyber Kill Chain Benchmark for LLM Evaluation

Measuring whether AI can autonomously execute multi-stage cyberattacks to inform deployment decisions at frontier labs

Runway till January: Amplify's funding ask to market EA & AI Safety 

Help us solve the talent and funding bottleneck for EA and AIS.

AURA Protocol: Measurable Alignment for Autonomous AI Systems

An open-source framework for detecting and correcting agentic drift using formal metrics and internal control kernels

SOTA Public Research Database + Search Tool

Unlocking the paradigm of agents + SQL + compositional vector search

Shallow Review of AI Governance: Mapping the Technical–Policy Implementation Gap

Identifying operational bottlenecks and cruxes between alignment proposals and executable governance.

SDCPNs for AI Safety

Developing correct-by-construction world models for verification of frontier AI

Disentangling Political Bias from Epistemic Integrity in AI Systems

An Integrative Framework for Auditing Political Preferences and Truth-Seeking in AI Systems

Guaranteed Safe AI Seminars 2026

Seminars on quantitative/guaranteed AI safety (formal methods, verification, mech-interp), with recordings, debates, and the guaranteedsafe.ai community hub.