Manifund foxManifund
Home
Login
About
People
Categories
Newsletter
HomeAboutPeopleCategoriesLoginCreate
header image

Technical AI safety

19 proposals
81 active projects
$4.72M
Grants228Impact certificates20
🍉

L

Visa fee support for Australian researcher to join a fellowship with Anthropic

Technical AI safety
2
0
$4K / $4K
🦀

Mirco Giacobbe

Formal Certification Technologies for AI Safety

Developing the software infrastructure to make AI systems safe, with formal guarantees

Science & technologyTechnical AI safetyAI governance
2
0
$128K raised
gergo avatar

Gergő Gáspár

Runway till January: Amplify's funding ask to market EA & AI Safety 

Help us solve the talent and funding bottleneck for EA and AIS.

Technical AI safetyAI governanceEA communityGlobal catastrophic risks
7
4
$500 raised
Miles avatar

Miles Tidmarsh

CaML - AGI alignment to nonhumans

Training AI to generalize compassion for all sentient beings using pretraining-style interventions as a more robust alternative to instruction tuning

Technical AI safetyAnimal welfare
2
1
$30K raised
NicoleMutunga avatar

Nicole Mutung'a

6 Month Stipend to Support a Transition to AI Governance Work

Funding research on how AI hype cycles can drive unsafe AI development

Science & technologyTechnical AI safetyAI governanceEA communityGlobal catastrophic risks
2
0
$0 / $7.5K
Capter avatar

Furkan Elmas

Exploring a Single-FPS Stability Constraint in LLMs (ZTGI-Pro v3.3)

Early-stage work on a small internal-control layer that tracks instability in LLM reasoning and switches between SAFE / WARN / BREAK modes.

Science & technologyTechnical AI safety
1
2
$0 / $25K
chriscanal avatar

Chris Canal

Operating Capital for AI Safety Evaluation Infrastructure

Enabling rapid deployment of specialized engineering teams for critical AI safety evaluation projects worldwide

Technical AI safetyAI governanceBiosecurity
3
7
$400K raised
MartinPercy avatar

Martin Percy

The Race to Superintelligence: You Decide

An experimental AI-generated sci-fi film dramatising AI safety choices. Using YT interactivity to get ≈880 conscious AI safety decisions per 1k viewers.

Technical AI safetyAI governanceBiosecurityForecastingGlobal catastrophic risks
1
1
$50 / $24.4K
🍇

Jade Master

SDCPNs for AI Safety

Developing correct-by-construction world models for verification of frontier AI

Science & technologyTechnical AI safetyGlobal catastrophic risks
2
0
$39K raised
🍇

David Rozado

Disentangling Political Bias from Epistemic Integrity in AI Systems

An Integrative Framework for Auditing Political Preferences and Truth-Seeking in AI Systems

Science & technologyTechnical AI safetyACX Grants 2025AI governanceForecastingGlobal catastrophic risks
1
1
$50K raised
AdamMorris avatar

Adam Morris

Train LLMs in honest introspection

Train LLMs to accurately & honestly report on their internal decision-making processes through real-time introspection

Technical AI safetyACX Grants 2025
0
1
$15K raised
Lisa-Intel avatar

Pedro Bentancour Garin

Global Governance & Safety Layer for Advanced AI Systems - We Stop Rogue AI

Building the first external oversight and containment framework + high-rigor attack/defense benchmarks to reduce catastrophic AI risk.

Science & technologyTechnical AI safetyAI governanceGlobal catastrophic risks
1
1
$0 / $350K
jlssapieninstitute avatar

Dr. Jacob Livingston Slosser

Do humans maintain independence in normative decision-making when using AI?

Help get the Sapien Institute off the ground

Technical AI safetyAI governanceEA communityGlobal catastrophic risks
1
0
$0 / $160K
orpheus avatar

Orpheus Lummis

Guaranteed Safe AI Seminars 2026

Seminars on quantitative/guaranteed AI safety (formal methods, verification, mech-interp), with recordings, debates, and the guaranteedsafe.ai community hub.

Technical AI safetyAI governanceGlobal catastrophic risks
5
3
$30K raised
Rubies93 avatar

Agwu Naomi Nneoma

Nneoma Agwu — Building a Career in AI Governance to Reduce Long-Term Risks.

Funding a Master's in AI, Ethics & Society to transition into AI governance and long-term risk mitigation, and safety-focused policy development.

Technical AI safetyAI governanceEA communityGlobal catastrophic risksGlobal health & development
1
0
$0 / $50K
Justin avatar

Justin Olive

Inspect Evals

Funding to cover our expenses for 3 months during unexpected shortfall

Technical AI safetyAI governance
10
4
$50K raised
🐷

Armon Lotfi

When Safety Testing Costs More Than Model Training

Multi-agent AI security testing that reduces evaluation costs by 10-20x without sacrificing detection quality

Science & technologyTechnical AI safetyAI governance
0
0
$999 / $15K
michaeltrazzi avatar

Michaël Rubens Trazzi

Finishing a Video on the Google DeepMind Hunger Strike

Funding gap to pay for a video editor and scriptwriter

Science & technologyTechnical AI safetyAI governance
1
3
$1.8K raised
Leo-Hyams avatar

Leo Hyams

Fund a Fellow for the Cooperative AI Research Fellowship!

A 3-month fellowship in Cape Town, connecting a global cohort of talent to top mentors at MIT, Oxford, CMU, and Google DeepMind

Science & technologyTechnical AI safetyAI governanceGlobal catastrophic risks
8
4
$2.53K raised
chris avatar

Chris Wendler

Enabling a Student to Present his Mechanistic Interpretability Work at NeurIPS

Help fund our student’s trip to NeurIPS to present his main conference paper on interpretable features in text-to-image diffusion models.

Science & technologyTechnical AI safety
1
3
$1.1K raised