what do you want to do

I noticed a problem with CEV that made Yudkowsky retract the most recently published version of his Sovereign AI proposal. If this version had been successfully implemented, then the outcome would have been really bad. Yudkowsky's retraction presumably removed most of the danger from the specific bad outcome that a successful implementation of this specific version of CEV would have resulted in. This shows that reducing this class of risks is a tractable research project.

I call this research Alignment Target Analysis (ATA). It is designed to reduce existential threats from scenarios where a Sovereign AI proposal with a hidden problem ends up successfully implemented. The reason more ATA is needed is that the retracted version of CEV is not the only dangerous alignment target that might end up successfully implemented. I would use the grant to pay myself a salary so that I can work on ATA full time.

The goal of my ATA research is not to find a good Alignment Target proposal. It is instead to reduce the probability of some very bad outcomes. So the goal is not to directly find a way to make AGI go well. But I hope it is still close enough. (In other words: as opposed to directly trying to construct a roadmap towards a good future, ATA is instead trying to identify one particular class of landmines. Which is probably better described as trying to reduce the probability of AGI going very badly, than as trying to make AGI go well).

Here is link to a post describing the problem with the version that Yudkowsky retracted (to see Yudkowsky's retraction you can search the CEV arbital page for Cederborg):

https://www.lesswrong.com/posts/LRuaCRpTc2zMhDDbb/a-problem-with-the-most-recently-published-version-of-cev

Here is link to a post describing the field of ATA, and arguing that ATA needs to be done now:

https://www.lesswrong.com/posts/QDseJ8wvtGwPWHpwX/the-case-for-more-alignment-target-analysis-ata

And here is link to a post describing some more of my ATA research:

https://www.lesswrong.com/posts/CJ7LsRpPjH7iAZxcB/a-problem-shared-by-many-different-alignment-targets

The project will be carried out by me, Thomas Cederborg. My CV:

https://thomascederborgsresearch.weebly.com/uploads/4/0/7/9/40798333/cederborgsupdatedcv.pdf

how are you planning to spend the money

I will use the funds from Leo's microgrant to pay myself a salary so that I can work on ATA full time until the grant runs out. If I receive additional funding, then I would be able to spend more time working on ATA full time.