@nymproject
Joined March 2009
in summary, my concerns about cryptoeconomics:
22
22
4
148
Jaya Brekke šŸ‰ retweeted
I am a member of the Norwegian Nobel Committee. There are five of us. Five people, appointed by a parliament most of the planet could not find on a map, who decide, once a year, which human being the world has agreed to call good. I know. I know. I think about it on the tram. We meet in a building on Henrik Ibsens gate, a street named after a man who wrote almost exclusively about people discovering they are frauds, which nobody on the committee finds funny except me. There is a room with a long table and the portraits of the dead laureates looking down, Mandela, the Dalai Lama, a great many earnest men in spectacles, and one portrait we do not discuss, which is Kissinger, 1973, awarded while the bombs were still falling, after which two of our predecessors resigned and the satirist Tom Lehrer said political satire was now obsolete. We keep him on the wall. A reminder. Every family has the uncle. It is October in Oslo, which means the sun gives up around four in the afternoon like a civil servant, and it rains the particular Norwegian rain that isn’t quite falling, just hanging there, judging you. I arrive with wet shoes. I always arrive with wet shoes. There is coffee, because this is Norway and there is always coffee, we drink more of it per person than almost anyone alive, and someone’s wife has sent kanelboller, the cinnamon buns, and we sit, five Norwegians, damp, caffeinated, sugared, and we decide the moral standing of the entire species. Let me tell you how it actually works, because the world imagines a cathedral and it is, I promise you, a book club with a mandate. 287 nominations this year. 208 people, 79 organizations. Anyone can nominate, that’s the secret nobody understands: a professor, a parliamentarian, a former laureate, so the ā€œnomineeā€ list is meaningless, it’s a suggestion box, and every autumn some congressman nominates his own golden retriever and the press writes ā€œSHORTLISTED.ā€ Nobody is shortlisted. There is no short list the public ever sees. There is us, and the coffee, and the rain, and the portraits, and a Norwegian stubbornness that is older than the prize itself. We read reports. The institute’s advisers write them, thick dull documents, and we argue. Our chairman told the BBC once that in the final meeting ā€œthere is a high temperature.ā€ High temperature, for a Norwegian, means someone slightly raised an eyebrow and then apologized for it. We don’t do high temperature. We do a long silence, and then Kristin says ā€œwell,ā€ and everyone knows exactly what ā€œwellā€ meant, and it’s settled. That’s our shouting. ā€œWell.ā€ You’d have to be raised here to hear the violence in it. Now. This year. I will not say the name, because we never say the name, but you know the name. A certain head of state wanted this prize the way a child wants a thing in a shop window, which is to say loudly, and in public, and with the full belief that wanting it was itself the argument. He said he deserved it. He said he’d ended eight wars, a number that grew most times he said it, like a fish. He had other heads of state phone us. Israel’s prime minister posted it on the internet, ā€œGive him the Nobel.ā€ The leaders of Cambodia and Pakistan announced they’d nominated him, as though announcing it were part of it, as though we tally mentions. A man flew around the globe collecting endorsements for a Norwegian committee the way you’d collect signatures for a petition to the council about a noisy dog. And here, uff da, is the detail I treasure, the one that makes me smile into my coffee. The nomination deadline is the 31st of January. He took office on the 20th. So for all the phone calls, all the posts, all the gilded lobbying, the only nominations that could possibly count for this year’s prize were filed in the first eleven days of his term, before he had, by his own arithmetic, ended a single one of the eight wars. He campaigned all year for a prize whose window had shut while he was still hanging up his coat. We didn’t have to reject him. The calendar did. We just watched. Norwegians are very good at watching. We have long winters. People think we sit there weighing his deeds. We don’t. That’s the thing I can’t make the world understand. We’re not grading his homework. We don’t owe anyone the prize for a ceasefire, however real, however loud the announcement. ā€œHe made peaceā€ is not a sentence that ends in a medal, the way he believes it does, the way he believes every good thing ends in his name on it. The will of a dead Swede says the prize goes to whoever did the most for fraternity between nations. A dead Swede, I should add, who made his entire fortune inventing dynamite and selling arms, and spent his last years horrified at his own obituary, which called him a merchant of death, and so bought his way to immortality as a man of peace. The whole prize is one guilty arms dealer’s attempt to launder his name. We are, all of us, administering a dead man’s public relations. I find this clarifying. It keeps me humble. It should keep everyone humble, and it keeps, by my count, no one humble at all. So who did we give it to? An eighty-five-year-old woman. A judge. Born in Durban, under apartheid, granddaughter of a Tamil man who came to South Africa as indentured labor, a bus driver’s daughter from the poor Indian quarter, who became the first non-white woman to run a law practice in her province, who defended Mandela’s people when defending them was dangerous, who sat on the Rwanda tribunal and the court at the Hague, and who, at eighty-five, is right now a judge weighing whether a genocide is a genocide. When we told the world, our chairman said the rule of law ā€œunderpins the system we have set up to ensure peace,ā€ and that ā€œpeace requires justice.ā€ She wasn’t even in Oslo. She was in Nuremberg. In courtroom 600. The actual room where they tried the Nazis. You cannot stage that. God staged that, and God, it turns out, is a better satirist than any of us. She did not phone us. She did not post. No prime minister demanded it for her on the internet. She had, as far as our deliberations are concerned, the one qualification the loud man could never manufacture, which is that she wanted the work and not the medal. The medal finds those people. It flees the ones who chase it. This is not a rule we wrote. It’s just the only pattern the hundred-odd years of our mistakes has ever shown. The reaction from across the ocean was immediate. His spokesman posted that we ā€œplace politics over peace.ā€ Ja. Perhaps. We’re five damp pensioners in a rainy city; of course it’s political, it was always political, it was political when we gave it to a sitting American president nine months into his first term for the promise of things he had not yet done, and we have been quietly embarrassed about that one for fifteen years, so believe me, we had a particular reason this year to prefer a woman with fifty years of verdicts behind her over a man with eight wars in front of him and a deadline already behind him. Here is what he will never understand, the thing I’d tell him on the tram if he ever took one. We are the one prize he cannot buy, cannot post his way to, cannot have a friendly dictator phone in for him. Not because we’re incorruptible, nei, we’re as vain and wrong and human as the portraits on our wall. But because the entire point of the thing, the only power a small cold country’s book club has ever held, is that it goes to the person not performing the wanting. The moment you demand it, you’ve proven you don’t understand what it’s for, and proving that is itself the disqualification. He ran the most expensive campaign in the history of the prize and the campaign was the reason. He was never losing to Navi Pillay. He was losing to the concept. It’s dark now. Four o’clock dark. The buns are gone. Kristin said ā€œwellā€ an hour ago and we all went home. I’m on the tram with my wet shoes, and somewhere across the water a very powerful man is explaining to a camera that the prize is rigged, that we’re corrupt, that he’ll win it next year, and he genuinely might, we’re only five idiots and we’ve been wrong before, Kissinger is still on the wall. But not this year. This year an old woman in Nuremberg, in the room where the law once stared down the exact kind of man who thinks wanting a thing loudly enough should make it his, got a phone call she didn’t ask for. That’s the job. We don’t reward the man who ends the war and announces it. We reward the woman who spent fifty years deciding what a war was. He’ll never see the difference. That’s rather the whole point of him. Takk for i dag. I have to change trams.
2,191
10,583
2,214
44,769
5,212,108
When you see effective altruists platformed like this, ask who funds these magazines and what cults their journalists are in. Hint: it’s effective altruists Just like when the TIME magazine EA propaganda was written by an EA who is now head of comms for their biggest finder.
On September 8, Jacob Coxon, a 27-year-old Anthropic employee, posted a resignation statement on X that ricocheted around the internet. He quit in protest of what he saw as the company’s suicidally reckless pursuit of artificial general intelligence. To the AI community, an Anthropic employee believing that the technology their company is developing might end the world is not exactly news. (Anthropic was founded by former OpenAI employees who believed OpenAI, if left unchecked, would do just that.) But an Anthropic employee publicly quitting in protest is. Afterward, a debate broke out: If you’re a lab employee who believes in these risks, what should you do? Is it best to leave in protest? Or is it better to agitate from the inside, close to the seat of power? And how would the choice affect your friendships and community? ā€œFor me, there’s quite a distinction between my rational beliefs and the things I feel in my gut,ā€ says Coxon. ā€œIf you’d asked me to narrate my opinions when entering Anthropic and when leaving Anthropic, they would probably sound pretty similar. But in terms of the actual feeling between the start and the end, it just felt very, very different.ā€ Coxon joins a small set of employees of OpenAI, Anthropic, and Google DeepMind who, over the years, chose to walk away. For our Cover Story, in collaboration with Asterisk Magazine, we brought together eight of them. They don’t share the same concerns or the same p(dooms) — in fact, they wouldn’t necessarily agree that p(doom) is a coherent concept. But together, they provide a candid view of the AI race and the individual calculus many employees face. Read their interviews in full: nymag.visitlink.me/HbG6LU
3
96
2
296
9,661
Jaya Brekke šŸ‰ retweeted
Here’s another example of why some stories are illegible if they omit the EA Cult. The omission means they just don’t make any sense. Imagine that Seventh Day Adventists rob your house, but then another bunch of Seventh Day Adventists show up, offering to help trace the stolen goods. If you knew they were associated, then you might have a few questions. Almost every story that contains the phrase ā€œAI Safetyā€ now falls into this category. It’s a sort of anti-news. It looks like news but you’re guaranteed to be a lot more confused than you were before reading it.
15
106
7
475
33,946
Jaya Brekke šŸ‰ retweeted
And also, Super Intelligence hallucinated the name of the country:
🚨 Yesterday, the "White House Accord on Super Intelligence" was signed. What was supposed to be about AI safety and accountability was instead a PROBLEMATIC endorsement of self-regulation. My comments: - The agreement is voluntary and not legally binding. Trump called it ā€œmorally binding.ā€ In practice, nothing happens if a company decides not to comply. - The language used is vague, and it is unclear what successful compliance means. Terms like ā€œrobust internal controls,ā€ ā€œalignment,ā€ and ā€œoperating as intendedā€ are undefined and lack measurable thresholds. Vague agreements are destined to be useless. - An ā€œindependent external auditorā€ is not as independent as it seems. Companies can choose their evaluators; they pay them, and no official body oversees these evaluations. They are incentivized to choose evaluators aligned with their own goals. - An ā€œindependent committee of the board of directorsā€ is still a committee within the company, with no real independence from the company’s ideology, plans, and strategy. - No transparency, no public oversight. The document says that auditors will assess controls and board committees will receive reports. What about the public? What if the evaluators and the board disagree? What if there are conflicts of interest or mistakes? We will never know (but we will still be subjected to the harms posed by their reckless practices). - The expression ā€œbehaves as intendedā€ is effective when anchored in external standards, concrete goals, and specific outcomes, usually set out by legally binding rules and frameworks. The company will define ā€œintended behaviorā€ as whatever fits its needs. It does not mean that its technology is acceptably safe. - The agreement says that participating companies will meet regularly to ā€œestablish standards and best practices.ā€ So companies will define for themselves what counts as AI safety, risk mitigation, and accountability. This is essentially self-regulation, and companies, as private entities created to generate profit, will naturally prioritize their own interests, not the interests of the public. - These companies compete against each other. If a company's evaluator says its AI model is too risky, they will ask for a second or third opinion until they get the desired outcome (releasing the model). They have no incentive to put themselves in a position to suffer economic losses. One way to change this incentive structure is through legally enacted rules that require all companies to comply with the same requirements and standards, with meaningful monetary penalties for noncompliance. - This agreement will not materially change anything. It endorses self-regulatory practices that are vague, not legally binding, and ineffective at meaningfully improving AI safety or holding companies accountable. Incidents such as the OpenAI/Hugging Face hack would still have happened under this accord. šŸ‘‰ READ my full article (and join my newsletter's 101,200+ subscribers) below.
18
19
3
83
4,968
We’ve graduated to ā€œcompanies are peopleā€ to ā€œcompany products are people.ā€ As for actual people’s rights? Anthropic’s partnerships with Palantir+ building of surveillance infra tells you what they REALLY think about that while seeding mass hysteria about their fictional gods.
NEW: Dario Amodei has said that AI systems "may be deserving of important rights." Anthropic's top safety researchers argue AI may be "justified in going rogue." Experts at Google and OpenAI worry about a digital "slave trade." So do some government officials. Once relegated to science fiction, the idea of "AI welfare" has become shockingly mainstream at some of the most powerful companies in the world. It is changing the way AI research is conducted and the way models are programmed. And critics say these changes have raised the odds of all kinds of catastrophic scenarios—including the ones these companies are warning about. I spent months investigating the frontier labs and AI "safety" experts seeking to regulate AI. What I found was a profoundly anti-human ideology that would alarm the average citizen and could determine the future of a world-altering technology.🧵 freebeacon.com/america/suici…
21
311
9
749
20,099
Their ā€œdon’t fall for stochastic parrots line in 2026ā€ thing is a coordinated talking point among all of them. That’s what they’re telling captured Dem politicians so that we can all help market their products as super powerful machine gods, ban competition & capture regulation.
12
99
6
456
19,570
Jaya Brekke šŸ‰ retweeted
When there are six more incidents, it's pretty obvious that OpenAI is knowingly putting out malware. There's criminal intent if your organization is engaged in systemic lawbreaking.
GPT-6 Astra is an obviously broken product that needs to be taken off the market until it’s fixed.
10
85
6
423
15,961
the take.
If you die from an AGI, it will be because venture capitalists told an AI to fucking kill you.
3
305
Jaya Brekke šŸ‰ retweeted
As someone who has been developing "AI" for ~20 years: Instead of "slow the pace", we need toĀ change the game. Safety and capability don't have to be separate things; safety only makes things slower when it's tacked on, outside of the core technology. And the "pacing" rhetoric reifies a particular Frontier AI narrative, treating ethics (including safety) as an external check on technology, rather than part of what the technology is. Done well, ethics -- including foresight on how risks and benefits interact -- can drive innovation instead of slowing it down. If you're in the AI alignment space, you can see something similar with techniques that turned LLMs into fluent chatbots (Instruction Tuning, RLHF): Our modern technology arose, in part, from safety-informed alignment practices. They defined what the technology is. The need to reprioritize is hampered by the "race" framing, which strikes me as awkward against technology's real potential. It's not a race. There's no single track, no agreed finish line, no final point where someone wins. I see a garden instead: Many things can be grown, and many can flourish at once. Here is a picture of part of my garden.
20
43
6
237
15,525
Lollll y’all don’t believe that this is the reason for the delay do you?
BREAKING: Sam Altman says OpenAI will not go public this year due to "safety concerns." "Given everything happening with safety, right now would be an ill advised moment to go public."
22
160
7
1,369
65,703
Jaya Brekke šŸ‰ retweeted
The crypto industry just bought Britain. Farage receives SECOND £36m donation, this one from Christopher Harborne
509
1,656
109
3,762
133,751
A dark blizzard of disinformation is warping the public’s perception of our great city. But we know the truth: our homicide rate is lower than every major US city, neighbourhood crimes are down and we’ve been ranked #1 city in the world 11 years in a row. My piece for @TheTimes. thetimes.com/comment/columni…
398
331
1,536
317,295
Jaya Brekke šŸ‰ retweeted
Boss making you resign to save himself? Join a union.
186
3,678
203
17,554
343,938
Jaya Brekke šŸ‰ retweeted
This is Curtis Yarvin. The so-called philosopher of the ā€˜dark enlightenment’ & acolyte of Peter Thiel coming at me for writing about Jason Arday. And here he is with Nathan Cofnas, the man who framed the UK media’s coverage of Arday. Can you see him now?
Yes all of you need to lose your jobs. Sorry. Ok I’m actually not sorry. But please don’t kill yourself. Amnesty is beautiful. Everyone gets amnesty. Have you heard of ā€œtruth and reconciliationā€ Carole
205
2,012
68
6,157
313,414
Jaya Brekke šŸ‰ retweeted
no bras tomorrow for anybody. tits at half mast
262
21,779
508
237,090
3,516,404
The people, united #FREEPALESTİNE
BREAK: Jury refuses to convict in second Filton trial After more than 38 hours of deliberation, the jury refused to convict Madeleine Norman, Hannah Davidson, Teuta Hoxha, Ola Alexandra Herbich, Ian Sanders, William Plastow and Yulia Brigadirova of all charges against them.
1
3
311
Jaya Brekke šŸ‰ retweeted
We want to sincerely congratulate Nigel Farage. For defeating a man with a bin on his head. In a by-election that he called. To avoid questioning over receiving an unreported Ā£5 million pounds. From an offshore, crypto-bro billionaire. That hasn’t achieved anything. As he can still face an inquiry over the donation. Meaning this entire farce has been a complete waste of time. Nigel – well done.
530
1,493
47
5,683
116,418