Some “coherence arguments” are two different things in a trenchcoat

T2Covered by 1 source · first reported by AI Alignment Forum / LessWrong (curated) at 02 Nov, 15:48 UTC

The “two kids in a trenchcoat” trope, in case you haven’t heard of it. Image sources: 1, 2 tl;dr I go through three “coherence arguments”, related to (1) market competition, (2) AI self-reflection and self-modification, and (3) AI training algorithms. I argue that each of these implies a pressure…