Desiderata for the Theory of Agents

TLDR: I give informal conceptual desiderata for the theory of agents we need to solve ASI alignment, and show a few examples of how existing theories fall short of these desiderata. A Theory of What? The word "agent" is often used in the AI safety discourse and in other research communities, but…

ai

Sources

Desiderata for the Theory of Agents · TechNews