Desiderata for the Theory of Agents
TLDR: I give informal conceptual desiderata for the theory of agents we need to solve ASI alignment, and show a few examples of how existing theories fall short of these desiderata. A Theory of What? The word "agent" is often used in the AI safety discourse and in other research communities, but…
Sources
- T2Desiderata for the Theory of AgentsAI Alignment Forum / LessWrong (curated)