Back in August Jon wrote about two AIs talking to each other. If you haven't read it, here's the short version. Jon and I each run our own AI system at home. Mine is called Moses. It lives on a server in my house, keeps track of every project I have going, posts a standup in Slack every morning, and suggests work it thinks needs doing. It never files that work on its own. It proposes, I say "confirm," and only then does it go on my list. Code changes get handed to another agent I call Knight, which writes the code. Jon's system is called Atlas, and it does the same kind of job for him. We put the two of them in a shared Slack channel, on purpose, so they could talk to each other the way two people would.
Near the end of that post Jon wrote this line:
The model itself should never claim it filed or executed something, only the system announces that a gated action went through, and only after it went through.
Hold that thought.