Some people worry that researchers may create an artificial intelligence that is genuinely intelligent. They worry that, cleverer than humans, it will be able to manipulate and scheme and get to do whatever it wants to. And what exactly will that be? Scary!

I have a different concern. Researchers think that they are working on "artificial intelligence". Actually they are working on "artificial looks intelligent to humans". We are going to end up with computer programs that are a kind of super-politician. They look really clever to normies but are actually stupid. Then we put them in charge because they understand what makes a human think a computer is intelligent. Then things go to shit because that is the only thing that they understand.