This is a pretty cool idea. The big question I see the two of you discussing is how to make the thing generic enough to allow anyone to upload arbitrary functions to the DHT in a way that processors could download them, execute them, and produce verifiable results. Quite similar to what Golem is trying to tackle; I agree.
Here’s a thought: maybe the sandboxed execution engine could live in a client outside the DNA, and the DNA’s only function is to share functions and inputs with those who want to download and process them.
Another idea: maybe the DNA itself is the thing that processors download and execute. One DNA per job. The infrastructure is already there in the Holochain conductor. Joining the DNA means you get access to both the functions and their inputs, and entitles you to claim a reward. One way you could do this is to have 100% replication and have the processing actually happen in the validation function, so as you receive a dataset you automatically process. This is a horrible abuse of validation functions, but it’s an interesting idea nonetheless
@rlkel0 do you know how Golem does verification of outputs? Do job uploaders just say “I want n confidence that these results are correct” and then n processors run the job and compare results?