Manifund foxManifund
Home
Login
About
People
Categories
Newsletter
HomeAboutPeopleCategoriesLoginCreate
header image

Technical AI safety

32 proposals
85 active projects
$5.84M
Grants279Impact certificates20
🐧

Nicolaus Qammaniq

Project Title: "Publishing Constraint-Preserving AI Analysis of Critical Systems

Amount Requested: $2,500 Timeline: 3 weeks (March 1 - March 22, 2025) One-line Summary: Funding to publish constraint-based dependency analysis of China's semic

Technical AI safetyAI governanceForecastingGlobal catastrophic risks
1
0
$0 / $2.5K
AI-Safety-Asia- avatar

AISA

AI Crisis Convening at India AI Impact Summit 2026

Translating in-person convening to measurable outcomes

Technical AI safetyAI governanceGlobal catastrophic risks
2
0
$100K / $100K
jessicapwang avatar

Jessica P. Wang

Safe AI Germany (SAIGE)

Germany’s talents are critical to the global effort of reducing catastrophic risks brought by artificial intelligence.

Science & technologyTechnical AI safetyAI governanceEA communityGlobal catastrophic risks
17
13
$560 / $156K
Tom-Maltby avatar

Tom Maltby

Validating Gains from Derivable Alignment

A Three-Month Falsification First Evaluation of CREATE

Technical AI safetyAI governance
1
0
$0 / $49K
aashkapatel avatar

Aashkaben Kalpesh Patel

Help a Bootstrapped AI Risk Literacy Founder Get To IASEAI 2026 in Paris

Nutrition labels transformed food safety through informed consumer choice, help me do the same for AI and make this standard :)

Science & technologyTechnical AI safetyAI governanceEA communityGlobal catastrophic risks
6
9
$145 / $3.04K
remmelt avatar

Remmelt Ellen

12th Edition of AI Safety Camp

Technical AI safetyAI governance
2
0
$40K / $90K
Mercy-Kyalo avatar

Mercy Kyalo

AI Safety East Africa (AISEA)

Operational costs for AISEA

Technical AI safetyAI governance
1
0
$0 / $5K
Mateusz-Bagiski avatar

Mateusz Bagiński

Ambitious AI Alignment Seminar

One Month to Study, Explain, and Try to Solve Superintelligence Alignment

Technical AI safetyGlobal catastrophic risks
10
15
$5.5K / $180K
🍄

Anthony Etim

Protecting GPU LLM inference from model-weight and IP theft (Research)

Defense-first monitoring and containment to reduce catastrophic AI risk from stolen frontier model weights

Science & technologyTechnical AI safetyEA communityGlobal catastrophic risks
1
0
$0 / $70K
LA_BUILDS avatar

Larry Arnold

Red Set ProtoCell: An Open-Source Immune System for AI Models

A modular red-teaming and risk-evaluation framework for LLM safety

Science & technologyTechnical AI safetyAI governanceForecastingGlobal catastrophic risks
1
0
$0 / $10K
Manraj avatar

MANRAJ SINGH

New way of Thinking about Benchmarks

Exploring ways of Benchmarking that do not get saturated over time

Technical AI safetyAI governance
1
0
$0 / $8K
Vahit avatar

Vahit FERYAD

Verified GenAI: Agentic QC for Reliable Product Visualization

Build an agentic LLM+VLM pipeline that generates product visuals and automatically verifies identity, color, and artifacts, enabling scalable, trustworthy e-com

Science & technologyTechnical AI safetyAI governance
1
0
$0 / $20K
am77 avatar

Adithyan Madhu

FLUQ: Restoring Trust through Decentralized Verifiable Randomness

Building an open-source protocol to ensure that digital luck and high-stakes selections are provably fair, transparent, and beyond the reach of centralized bias

Science & technologyTechnical AI safety
1
0
$0 / $20K
🐠

Tomasz Kiliańczyk

"Emergent Depopulation": Translation and Publication

Translating an AI safety report (1k+ downloads) for peer-reviewed publication to formalize "Emergent Depopulation" as a novel systemic risk.

Technical AI safetyAI governanceEA communityForecastingGlobal catastrophic risks
1
0
$0 / $2.5K
Cefiyana avatar

Cefiyana

Neuro-Safety: Reducing AI Latency for Bio-Safe Interaction

Developing an Edge-AI framework to reduce response latency to <0.6s, mitigating user cognitive stress and establishing "Digital Pharmacotherapy" standards.

Science & technologyTechnical AI safetyBiomedicalGlobal health & development
1
0
$0 / $12K
🐢

Boyd Kane

Get OpenAI employees addicted to factorio

by buying gift cards for the game and handing them out at the OpenAI offices

Technical AI safety
1
3
$0 / $3.5K
🥕

Jacob Steinhardt

Transluce: Fund Scalable Democratic Oversight of AI

Technical AI safetyAI governance
5
2
$40.3K / $2M
Krishna-Patel avatar

Krishna Patel

Isolating CBRN Knowledge in LLMs for Safety - Phase 2 (Research)

Expanding proven isolation techniques to high-risk capability domains in Mixture of Expert models

Technical AI safetyBiomedicalBiosecurity
4
4
$150K raised
ltwagner28 avatar

Lawrence Wagner

Reducing Risk in AI Safety Through Expanding Capacity.

Technical AI safetyAI governanceEA communityGlobal catastrophic risks
2
3
$11K raised
Igor-Labutin avatar

Igor Labutin

AI:Save Our Souls

A tech-infused immersive musical. Experience the future of storytelling where artificial intelligence meets the depths of human emotion.

Science & technologyTechnical AI safetyAI governance
2
0
$0 / $120K