Exciting topic of research, looking forward to following your success, Samuel!
$89,600 left to reach the funding goal.
website: https://www.mindscapes.world/
Mindscapes is an interdisciplinary research group based in Oxford, building rich worlds and characters for understanding and shaping the psyches of LLMs.
The primary aim of Mindscapes is to develop a science of LLM psychology, character training and multi-agent interaction dynamics from the ground up. In particular, I am interested in:
a) crafting characters with deeply internalised morality (as opposed to reward sycophants)
b) character training methods based on self-distillation that can scale in a robust way alongside capabilities RL
c) creating rich, diverse simulated worlds using fine-tuned base models for training and observing the behaviour of different LLM characters
d) qualitative, non-prescriptive character evaluations that are incentive-compatible even under the assumption of eval awareness
I will be assembling a team drawing from both technical and non-technical fields such as experimental psychology, anthropology, literature, philosophy, geography etc. We will be designing character and worlds, observing these characters in diverse environments, and using these observations as the basis for generating testable theory. The project will be mostly part time until 5 December (Oxford end of term) and a smaller group will be selected to work full-time during the holidays.
Minimal funding:
Compute + API costs: $26,000
Recruitment + outreach: $4,000
At this level, we would focus on post-training 7-14B models, delivering research blog posts and an open-source library and guide for character training and evaluations.
At $60k, we could scale up to multiple runs on llama 70B base and larger datasets, begin investigating more complex multi-agent dynamics.
At $120k, we could do experiments in fine-tuning large MOE models such as Kimi and Deepseek via Tinker, and scale up the number of fellows. We could also pay research managers and support with travel and accommodation for those moving to Oxford.
I (Samuel Ratnam) am a Computer Science and Philosophy undergraduate at Hertford College, Oxford and will be leading this project. Previously, I have worked at Workshop Labs (https://www.workshoplabs.ai/) on model personalisation and on Alignment Pretraining (https://arxiv.org/abs/2601.10160) in collaboration with Geodesic Research and UK AISI. I also co-founded and help run the Idealists Collective (https://idealistscollective.org/) - a community of over 150 philosophers, artists and technologists for imagining and creating better futures. I am also mentoring SPAR projects on generalisation engineering and model welfare.
Advisory Board:
- Anders Sandberg (Institute for Future Studies, formerly FHI)
- Jai Dhyani (Separatrix)
- Arthur Roing Baer (Moving Castles)
- Celeste (computer-10)
- David Africa (Resolution)
- Antra Tessera (Anima Labs)
Note: We also have an application for a $100k seed grant in progress from bluedot impact
Justin Shenk
12 days agoExciting topic of research, looking forward to following your success, Samuel!
Attila Tóth
13 days agoCongrats on reaching the minimum! Two things from our long runs in Arena that might be useful for your character evaluations:
1. Stated reasons and behaviour can drift apart. In one run, 229 decisions gave loneliness as the reason, but those decisions took under 3% of the agents' time. We now log what an agent says and what it does separately, and compare them.
2. The world itself writes part of the character. A single field label ("dry soil far from water") made our agents invent a goal: 340 of 938 decisions mention a water container that doesn't exist in that world. So we record exactly what each agent saw at every decision, and replay it.
Happy to share our run logs and replay format if it helps.
Attila
Austin Chen
20 days agoVery excited for this. I've spoken before with Samuel and quite like his work and general orientation. This project sounds very similar to projects I have personally considered exploring, and so I am interested in seeing what Mindscapes publishes. I'm almost completely out of Manifund budget, but hope to donate more soon.
I am curious why this is framed as a fellowship/fieldbuilding initiative, rather than just directly funding Samuel and a team to work on this directly?
Samuel Ratnam
20 days ago@Austin Thanks Austin! This is a good question, and after reflecting on it, I'm not entirely sure a fellowship is the best structure for this project. However, it does seem to me that there is so much low-hanging fruit to explore that quickly upskilling a larger pool of relatively low-context people from diverse fields will pay more dividends (even in the short term) than a smaller team of higher-context people. After the 5th of December (when Oxford term ends), I expect we may be in a position to have people working on this directly full-time.
Have updated the project description.