Support the AI Policy Institute for AGI preparedness polling and education

Human-Side Alignment Risks in Non-Self Language Models

Projection, sycophancy, and institutional artifact fabrication in AI-mediated supervision.

A Small AI Governance Evidence Kit from Türkiye

A micro-project to turn an early AI governance prototype into risk notes, oversight checklist, review templates and public learning.

Affective Coherence Monitoring for Transformer-Based Language Models

TIANXIA — Formal AI Governance Through Chinese Classical Operators

TIANXIA — Formal AI Governance Through Chinese Classical Operators

Travel Grants for New Zealand's Inaugural AI Safety Conference

$5,000 USD to bring 16 vetted academics and policy leads to NZ's first AI Safety Conference, ensuring national representation and cross-sector collaboration

Guardian-Agent: Python port, conformance suite, red-team scorecard, SPEC v1.0

AGPL supervisor library for LLM agents. TS reference live on npm today (@flowdot.ai/guardian-agent). Grant funds Python parity, conformance suite, SPEC v1.0.

Solon: A Reliable Autonomous ML Research Agent

Building an AI research agent that can propose, test, and write up small ML findings

Agent Threat Rules (ATR): open detection rule corpus for AI agent attacks

344 MIT rules merged into Microsoft Agent Governance Toolkit, Cisco AI Defense, MISP, OWASP. Microsoft Copilot SWE Agent uses ATR for CVE triage.

Funding to work on global AI safety and governance infrastructure

Building early AI governance and safety systems focused on alignment, oversight and risk reduction before more capable AI arrives.

Tripwire, a pre-deployment blast-radius static analyser for LLM-agent configs

`pip install tripwire; tripwire check <config>` to compute the blast radius of a prompt-injection against your agent's MCP servers, OAuth tokens, and tool calls

Probehalter, an evaluation harness for tool-abuse risks in LLM agents

Open-source Python harness any team can `pip install` to evaluate their LLM-agent deployment for tool-abuse risk.

Videos covering AI news and politics with a focus on the extinction threat

Social media content across YouTube, Instagram, and TikTok to grow AI x-risk awareness and build political momentum for a global pause.

Cross-provider audit of LLM-mediated market mechanisms

Small API budget to test whether semantic reporting failures in an OpenAI-validated VCG market simulation replicate across Claude and Gemini.

Modeling AI competition dynamics for better governance

Software tools and research to quantify coordination failures and inform policy decisions.

Summer AI Safety Workshops For 6th-8th Graders in India

Inspiring India’s Middle‑Schoolers to pursue AI Safety, Governance, and X‑Risk Work

Precautionary AGI Governance

Limited Legal Personhood as a Reversible Safety Instrument

Making AI Labs Accountable: Private Law Lessons from Commercial Space

Designing liability, insurance and fiduciary mechanisms for frontier AI using commercial space law as a structurally precise comparative framework

Safe AI Germany (SAIGE)

Germany’s talents are critical to the global effort of reducing catastrophic risks brought by artificial intelligence.

Meridian Eval: a public benchmark for tool-routing failures in LLM agents

Make "which tool did the agent pick, and why?" an inspectable artifact instead of a vector lookup.