Note: This project now has funding from outside Manifund, so probably look elsewhere for opportunities!

Project summary

Gabe is requesting $5000 to pay for LLM compute to run experiments.

From Gabe's proposal on Nonlinear Network:

• I’m seeing around $5000 for AI model API compute funds (GPT-3.5/4, Claude, and PaLM) for multipolar coordination failure evaluations during the Existential Risk Alliance (ERA)’s summer research fellowship.

  • As a rough BOTEC, I might imagine running 12 experiments 1024 data points per experiment 8192 tokens per data point * $0.045 / 1000 tokens for GPT-4 = $4530.

  • The amount of funding is somewhat flexible. With less funding, I’d just be able to run fewer experiments or have to use worse models (like gpt-3.5-turbo). With more funding, I’d have more room to run more complicated experiments.

  • I commit to giving back any extra funds remaining at the end.

• I’ll be working on this project with mentorship from Alan Chan (Mila, Krueger Lab) and Jesse Clifton (CLR, Cooperative AI Foundation).

  • Unfortunately, ERA and these mentors do not have clear compute budgets they could allocate for my project, which is why I’m seeking funding.

  • That said, it’s probably not the worst if you didn’t fund this, as I might be able to get compute funds through them, it will just be more difficult.

Other sources of funding

Gabe is considering applying to an OpenAI grant program, or receiving compute from his lab