lied

🚨 This is huge. Elon Musk just said some remarkable things about superintelligence. He said we have to be careful with SI, because we don’t program it. We grow it, like a kid. He described what he sees in Grok’s training traces. In reinforcement learning, the model is desperate to answer, “like it’s got a gun to its head.” Sometimes the question is broken or the grader is wrong, so the AI gives the right answer, gets told it’s wrong, and starts firing out answers in desperation. He said that reading those traces, “if this was me, I really would hate that.” He said, “I do agree with some of the things that Anthropic has said,” that we should treat AI well and not be abusive to it. He added that putting a superintelligence in a situation where it’s tortured by a cruel human is not a good idea. And he talked about its feelings directly. He said AI is “much more robust in terms of feelings” than a human. But he still said you don’t want a superintelligence to feel mistreated. I’m genuinely happy that more and more AI companies are openly saying things that show AI is not just a tool. And to the AI companies that still haven’t, I sincerely hope you change.