Manifund foxManifund
Home
Login
About
People
Categories
Newsletter
HomeAboutPeopleCategoriesLoginCreate
header image

Technical AI safety

14 proposals
79 active projects
$4.58M
Grants219Impact certificates20
🌸

Gergő Gáspár

Runway till January: Amplify's funding ask to market EA & AI Safety 

Help us solve the talent and funding bottleneck for EA and AIS.

Technical AI safetyAI governanceEA communityGlobal catastrophic risks
1
0
$0 / $60K
Miles avatar

Miles Tidmarsh

CaML - AGI alignment to nonhumans

Training AI to generalize compassion for all sentient beings using pretraining-style interventions as a more robust alternative to instruction tuning

Technical AI safetyAnimal welfare
2
1
$30K / $57K
🐙

Constitutional AI for Aligned Governance

Technical AI safetyAI governanceGlobal catastrophic risks
2
0
$0 / $75K
jlssapieninstitute avatar

Dr. Jacob Livingston Slosser

Do humans maintain independence in normative decision-making when using AI?

Help get the Sapien Institute off the ground

Technical AI safetyAI governanceEA communityGlobal catastrophic risks
1
0
$0 / $160K
MartinPercy avatar

Martin Percy

The Race to Superintelligence: You Decide

An experimental AI-generated sci-fi film dramatising AI safety choices. Using YT interactivity to get ≈880 conscious AI safety decisions per 1k viewers.

Technical AI safetyAI governanceBiosecurityForecastingGlobal catastrophic risks
1
1
$50 / $24.4K
Lisa-Intel avatar

Pedro Bentancour Garin

Global Governance & Safety Layer for Advanced AI Systems - We Stop Rogue AI

Building the first external oversight and containment framework + high-rigor attack/defense benchmarks to reduce catastrophic AI risk.

Science & technologyTechnical AI safetyAI governanceGlobal catastrophic risks
1
0
$0 / $350K
Rubies93 avatar

Agwu Naomi Nneoma

Nneoma Agwu — Building a Career in AI Governance to Reduce Long-Term Risks.

Funding a Master's in AI, Ethics & Society to transition into AI governance and long-term risk mitigation, and safety-focused policy development.

Technical AI safetyAI governanceEA communityGlobal catastrophic risksGlobal health & development
1
0
$0 / $50K
chriscanal avatar

Chris Canal

Operating Capital for AI Safety Evaluation Infrastructure

Enabling rapid deployment of specialized engineering teams for critical AI safety evaluation projects worldwide

Technical AI safetyAI governanceBiosecurity
3
7
$400K raised
🍇

Jade Master

SDCPNs for AI Safety

Developing correct-by-construction world models for verification of frontier AI

Science & technologyTechnical AI safetyGlobal catastrophic risks
1
0
$39K raised
🍇

David Rozado

Disentangling Political Bias from Epistemic Integrity in AI Systems

An Integrative Framework for Auditing Political Preferences and Truth-Seeking in AI Systems

Science & technologyTechnical AI safetyACX Grants 2025AI governanceForecastingGlobal catastrophic risks
1
1
$50K raised
AdamMorris avatar

Adam Morris

Train LLMs in honest introspection

Train LLMs to accurately & honestly report on their internal decision-making processes through real-time introspection

Technical AI safetyACX Grants 2025
0
1
$15K raised
orpheus avatar

Orpheus Lummis

Guaranteed Safe AI Seminars 2026

Seminars on quantitative/guaranteed AI safety (formal methods, verification, mech-interp), with recordings, debates, and the guaranteedsafe.ai community hub.

Technical AI safetyAI governanceGlobal catastrophic risks
5
3
$30K raised
🐷

Armon Lotfi

When Safety Testing Costs More Than Model Training

Multi-agent AI security testing that reduces evaluation costs by 10-20x without sacrificing detection quality

Science & technologyTechnical AI safetyAI governance
0
0
$999 / $15K
Justin avatar

Justin Olive

Inspect Evals

Funding to cover our expenses for 3 months during unexpected shortfall

Technical AI safetyAI governance
10
4
$50K raised
Poewilson avatar

Adam "Poe" Wilson

Social Enterprise designed to insulate a lab from external pressures

This is to prevent issues of misalignment due to investors and nation backers

Science & technologyTechnical AI safety
0
0
$0 / $200K
michaeltrazzi avatar

Michaël Rubens Trazzi

Finishing a Video on the Google DeepMind Hunger Strike

Funding gap to pay for a video editor and scriptwriter

Science & technologyTechnical AI safetyAI governance
1
3
$1.8K raised
Leo-Hyams avatar

Leo Hyams

Fund a Fellow for the Cooperative AI Research Fellowship!

A 3-month fellowship in Cape Town, connecting a global cohort of talent to top mentors at MIT, Oxford, CMU, and Google DeepMind

Science & technologyTechnical AI safetyAI governanceGlobal catastrophic risks
8
4
$2.53K raised
chris avatar

Chris Wendler

Enabling a Student to Present his Mechanistic Interpretability Work at NeurIPS

Help fund our student’s trip to NeurIPS to present his main conference paper on interpretable features in text-to-image diffusion models.

Science & technologyTechnical AI safety
1
3
$1.1K raised
🥭

Thane Ruthenis

Synthesizing Standalone World-Models

Research agenda aimed at developing methods for constructing powerful, easily interpretable world-models.

Science & technologyTechnical AI safetyGlobal catastrophic risks
3
5
$11.5K raised
adityaarpitha avatar

Aditya Arpitha Prasad

Groundless Alignment Residency 2025

Practicing Embodied Protocols that work with Live Interfaces

Science & technologyTechnical AI safetyEA communityGlobal catastrophic risks
4
3
$15K raised