What progress have you made since your last update?

We have released a human-in-the-loop version of the game at https://agentisland.ai/. Give it a play!

What are your next steps?

Add additional game types and develop a scoring algorithm for the benchmark.

@Austin, thanks! As for the web UI, I just started working on HTML logs yesterday. I also quite like the idea of a human-in-the-loop.

I'm also in the midst of a refactor that makes for much easier extensions to different types of games. I've been watching The Traitors as of late, so Mafia is a game I'm especially excited to implement.

Update on Feb 19: context management is now implemented, and I'm working on an updated per-game cost estimate.