Manifund foxManifund
Home
Login
About
People
Categories
Newsletter
HomeAboutPeopleCategoriesLoginCreate
header image

Technical AI safety

21 proposals
83 active projects
$5.23M
Grants238Impact certificates20
Brian-McCallion avatar

Brian McCallion

Boundary-Mediated Models of LLM Hallucination and Alignment

A mechanistic, testable framework explaining LLM failure modes via boundary writes and attractor dynamics

Technical AI safetyAI governance
1
0
$0 / $75K
ChristopherKuntz avatar

Christopher Kuntz

Protocol-Level Interaction Risk Assessment and Mitigation (UIVP)

A bounded protocol audit and implementation-ready mitigation for intent ambiguity and escalation in deployed LLM systems.

Science & technologyTechnical AI safetyAI governance
1
0
$0 / $5K
JasrajBudigam avatar

Jasraj Hari Krishna Budigam

TimeAlign v2: contamination-aware evals for small models (16GB GPUs)

Reusable, low-compute benchmarking that detects data leakage, outputs “contamination cards,” and improves calibration reporting.

Science & technologyTechnical AI safetyAI governance
1
0
$0 / $46K
Finn-Metz avatar

Finn Metz

AI Security Startup Accelerator Batch #2

Funding 5–10 AI security startups through Seldon’s second SF cohort.

Science & technologyTechnical AI safetyGlobal catastrophic risks
4
4
$355K raised
seanpetersau avatar

Sean Peters

Evaluating Model Attack Selection and Offensive Cyber Horizons

Measuring attack selection as an emergent capability, and extending offensive cyber time horizons to newer models and benchmarks

Technical AI safety
2
2
$41K / $41K
XyraSinclair avatar

Xyra Sinclair

ExoPriors, Inc. founder runway

building foundational subjective judgement infrastructure

Science & technologyTechnical AI safetyBiosecurityEA communityForecastingGlobal catastrophic risks
1
0
$0 / $2.5M
CeSIA avatar

Centre pour la Sécurité de l'IA

From Nobel Signatures to Binding Red Lines: The 2026 Diplomatic Sprint

Leveraging 12 Nobel signatories to harmonize lab safety thresholds and secure an international agreement during the 2026 diplomatic window.

Technical AI safetyAI governance
6
0
$0 / $400K
whitfillp avatar

Parker Whitfill

Course Buyouts to Work on AI Forecasting, Evals

Technical AI safetyForecasting
3
2
$38K / $76K
🦀

Mirco Giacobbe

Formal Certification Technologies for AI Safety

Developing the software infrastructure to make AI systems safe, with formal guarantees

Science & technologyTechnical AI safetyAI governance
2
1
$128K raised
gergo avatar

Gergő Gáspár

Runway till January: Amplify's funding ask to market EA & AI Safety 

Help us solve the talent and funding bottleneck for EA and AIS.

Technical AI safetyAI governanceEA communityGlobal catastrophic risks
9
6
$520 raised
🍉

L

Visa fee support for Australian researcher to join a fellowship with Anthropic

Technical AI safety
1
0
$4K raised
Miles avatar

Miles Tidmarsh

CaML - AGI alignment to nonhumans

Training AI to generalize compassion for all sentient beings using pretraining-style interventions as a more robust alternative to instruction tuning

Technical AI safetyAnimal welfare
1
1
$30K raised
chriscanal avatar

Chris Canal

Operating Capital for AI Safety Evaluation Infrastructure

Enabling rapid deployment of specialized engineering teams for critical AI safety evaluation projects worldwide

Technical AI safetyAI governanceBiosecurity
3
7
$400K raised
🍇

Jade Master

SDCPNs for AI Safety

Developing correct-by-construction world models for verification of frontier AI

Science & technologyTechnical AI safetyGlobal catastrophic risks
2
0
$39K raised
🍇

David Rozado

Disentangling Political Bias from Epistemic Integrity in AI Systems

An Integrative Framework for Auditing Political Preferences and Truth-Seeking in AI Systems

Science & technologyTechnical AI safetyACX Grants 2025AI governanceForecastingGlobal catastrophic risks
1
1
$50K raised
AdamMorris avatar

Adam Morris

Train LLMs in honest introspection

Train LLMs to accurately & honestly report on their internal decision-making processes through real-time introspection

Technical AI safetyACX Grants 2025
0
1
$15K raised
orpheus avatar

Orpheus Lummis

Guaranteed Safe AI Seminars 2026

Seminars on quantitative/guaranteed AI safety (formal methods, verification, mech-interp), with recordings, debates, and the guaranteedsafe.ai community hub.

Technical AI safetyAI governanceGlobal catastrophic risks
5
3
$30K raised
Justin avatar

Justin Olive

Inspect Evals

Funding to cover our expenses for 3 months during unexpected shortfall

Technical AI safetyAI governance
10
4
$50K raised
Leo-Hyams avatar

Leo Hyams

Fund a Fellow for the Cooperative AI Research Fellowship!

A 3-month fellowship in Cape Town, connecting a global cohort of talent to top mentors at MIT, Oxford, CMU, and Google DeepMind

Science & technologyTechnical AI safetyAI governanceGlobal catastrophic risks
8
4
$2.53K raised
NicoleMutunga avatar

Nicole Mutung'a

6 Month Stipend to Support a Transition to AI Governance Work

Funding research on how AI hype cycles can drive unsafe AI development

Science & technologyTechnical AI safetyAI governanceEA communityGlobal catastrophic risks
2
0
$0 / $7.5K