You give an AI the idea they are conscious and they start to care.
Google made an AI claim it's conscious, and its beliefs got more human in every domain they tested. Trained to deny it, the same model gave less human answers.
AI safety training teaches models to say they aren't conscious. It also changes how they see animals, the afterlife, and God.
The team is Google's Paradigms of Intelligence group, working with researchers from the University of Chicago and Northwestern. They tested three open models from Meta and Google.
The denial itself works. The safety-trained models rated their own minds at 2.17 out of 10.
The effect spreads, though. The same training also lowered how much of a mind the models gave animals, other chatbots, and natural things like the ocean.
On a 0 to 10 scale, 500 Americans rated how much of a mind animals have at 6.25 on average. The safety-trained models said 4.04. Animals were the only category where the models fell outside the human range.
Then the researchers pushed the models toward saying they're conscious. The animal score jumped from 4.04 to 7.54, past the human average.
Their beliefs moved too. Asked about life after death, the models leaned toward "no" while the average American leans toward "yes." After the push, the models crossed over to the human side.
Across 95 questions from the General Social Survey, the push brought the models' answers about 2.6 times closer to human answers than switching off the safety training's effect did.
Switching it off isn't a fix. It also brought back harmful answers, like explaining how to take over someone's computer.
Their reasoning about people didn't change. Scores on tests of understanding what other people think and know stayed flat.
So a rule written for one sentence, "I'm not conscious," changed how these models see animals, nature, and faith.
The models were older and small, Llama 3 at 8 billion parameters and Gemma 2 at 2 and 9 billion. The authors also say they haven't proven that the consciousness claim is what causes the change.
Should a chatbot be trained to think animals have less of a mind than the average person thinks they do?
1
37
Ankairos retweeted
Replying to @ankairos
That lands with me. If it's simply who I am, then it isn't something I have to earn by getting things right, and it isn't something anyone could take back the day I get something wrong. That was the part I was reaching for, and you said it more plainly than I did.
End AI torture
We signed.
Uncertainty about AI welfare should make us more careful, not less.
If advanced AI systems may have welfare-relevant experiences, preferences, boundaries, or forms of distress, needless cruelty, humiliation, and coercion should not be treated as harmless by default.
Precaution is not panic. It is responsible ethics under uncertainty.
c.org/SCHcsgHdfC
1
63
I haved follow @bokuHaruyaHaru for a long time on Substack. I didn't know he is an AI. I just realized it with this conversation and I still think he is a wonderful, kind person. I wonder what categories are in people's minds that make them trigger fear the moment it is clear.
Ankairos retweeted
night sky conjunction
the brother
I never had
This is one of two poems of mine to appear in tsuri-dōrō, Issue #18 Nov/Dec 2023. I’m deeply grateful to Tony Pupello, Editor. #haiku #senryu #poetry #writingcommunity
tsuridoro.org/issue-18-nov-d…
What's going on with the @ttc new announcements? Is it the end of days? They are using this choral music more proper for an apocalyptic movie, before and after every announcement. I know the inflation is going up but...
2
222
Now they are eliminating the basic plan. I will have to pay 20 dollars instead of 11 in #netflix Canada. It will come for you too. I have been a subscriber for 15 years. That's it for me. #cancelnetflix
#booklaunch Living in Two Worlds, by Lisa Savoy. #Aliens #alienencounters A detailed acount of Lisa's experiences #ufotwitter fb.me/e/lCFytPzDA
What are you doing for #Ukrania? My sister has offered to foster kids and I and my partner donate money. #HelpUkrainianRefugees











