Manifund foxManifund
Home
Login
About
People
Orgs
Categories
Newsletter
HomeAboutPeopleCategoriesLoginCreate
🐬
🐬
Daniel Padbury

@dan1

0

$0total balance
$0charity balance
$0cash balance

$0 in pending offers

Projects

AGF: Runtime Policy Enforcement and Cryptographic Audit Trails for AI Agents

unfunded

By Daniel2Following1
AGF: Runtime Policy Enforcement and Cryptographic Audit Trails for AI Agents
🐬

Daniel Padbury

about 2 hours ago

I wanted to give some background as to how we got to this point as it shows the depth of detail we have gone into. It may also help get us over the line.

Last year I started investigating how to ensure that the behaviour of AI agents was something that could be controlled, audited and not be bypassed. I built a model with Kimi and asked 1000s of questions. I found myself stranded on a Thai island (Koh Lipe) in the worst rains they have had in 300 years. For a month I was locked in a room conceiving different scenarios and ways in which one could ensure governance that worked for all. I did a lot of the legwork but Kimi was invaluable and the Agentic Governance Framework was born. I got chest pains and genuinely thought I was going to keel over before I could tell anyone.

Thankfully they subsided and I immediately sought a UK patent and engaged a UK Investment Firm to sell it to a hyperscaler. Amazon was interested but wanted me to build it and then we could talk again. Off I went and honed the idea further with Qwen and then it dawned that this could have national security implications.

Since then I have consulted various experts and now have a small development team ready to build the first open-source component. I spoke with VC’s but they could not give two hoots about AI safety especially when coming from someone who is self taught. It’s fair to say that this could not be built last year primarily because the technology did not exist and the performance was not there. Nvidia thankfully solved that and now we can safely build this and save humanity.

I need to spend £150,000 to build the first components that I can show to philanthropic groups and VC’s so they fundamentally understand the gravity of the discovery. We will be making the technology open-source and we have a project. 

I am guessing you are technical so we are using the seL4 microkit to enforce agent behaviour at the bare metal layer. It was a DARPA funded project out of the University of New South Wales. I actually shared this with Surrey and they ran off and got an ARIA grant so it must be a solid architectural approach. By having our own microkernel we lessen the surface area and we embed a tracker outside the agent that ensures that the mathematically verified proof is there before an action can be taken. It does this by consulting a semantic layer with rules (FCA, Geneva Convention etc). We take several best of breed open-source protocols (OpenTitan, Kani, Cedar) and build it out in Rust. Eventually this will be embedded in chips and Data Centres. Sounds simple doesn’t it but it’s not and I have University of Exeter involved to ensure that the formal verification and cryptographic attestation is best in class.

I have networked voraciously to get us to where we are now. Is its discovery as big as the worldwide web sadly no but it is on a par with SSL or TSL (assuming we can get it to work). There’s just a small matter of building it. We so desperately must explore this - trust me there is no other way to prevent rogue AI behaviour at an enforcement level. Likewise this has implications for recursive self-improvement and we have Canary to deal with that but that’s a whole other story. That concept can be used as the basis to determine agent to agent communication and ensure that nefarious behaviour is recognised. This is critical when multiple agents are talking to one another and with 1 billion agents expected by 2030 this is a time critical project. I really hope you endorse my perspective and that you feel empowered to act and get involved.

AGF: Runtime Policy Enforcement and Cryptographic Audit Trails for AI Agents
🐬

Daniel Padbury

about 22 hours ago

@keri @JueYan @Austin @joel_bkr In case this aligns with your AI safety grant thesis I would appreciate your feedback on our open-source deterministic runtime enforcement protocol please.