
CEO @Aitomatic—Builder, Leader, Professor, Advisor—Panasonic/Google/HKUST/Refugee—https://xitter.cf/t.co/cYhm4TNJXM. Industrial Brain Engg & Robotics—https://xitter.cf/t.co/bRduPruOny
Los Altos, CA
Joined December 2007
- Tweets16.4K
- Following815
- Followers5.8K
- Likes15.1K
Pinned Tweet
Replying to @ylecun
xitter.cf/pentagoniac/status/172…
💯 We will at some point have built reasoning engines that employ both internal and external feedback loops.
The external ones are those that leverage “language”, or symbolic tokens.
The internal ones are those that “do not require language”.
We will then have learned that today’s LLMs/transformers are a detour—an efficiency trick that avoids feedback loops—on the way to true, iterative/deliberative reasoning.
Christopher Nguyen ⽗ retweeted
The sustained info war assault on open models is an agenda driven, self sabotage for our society.
The PHP vulnerabilities were found by Sol 5.6 as part of a defensive audit, for example, not abliterated models.
Putting our head in the sand and pretending vulnerabilities do not exist is idiotic. Better we find all these old, human written mistakes and fix them with AI. If you have a pair of magic glasses that show you what buildings will fall down the answer is to fix the buildings, not smash the glasses.
When HuggingFace was under attack and when OpenCode was under attack they needed open models to defend them because closed models refused.
Eventually OpenCode, because they're a prominent project, were granted access to OpenAI Daybreak Blue. Many individual researchers get denied with obscure errors and no explanation. To be clear, DayBreak is a fantastic project, and OpenAI is doing their best to be responsible here, but not everyone gets access and everyone has a right to defend themselves.
Nobody should have to beg for permission to defend themselves from cyber assault. When you're under attack, waiting to see if you get granted access to defend yourself via a black box KYC process is how we end up helpless, watching as our shop burns while raging looters storm it and destroy our life's work.
AI can be used for attack and defense and many of the recent attacks used both open and closed models, by the lab's own admissions.
Open models are often the only thing standing between us and the new reality of cyber assault.
If we ban them or restrict them in the US, then US companies will just be defenseless against global cyber assault actors who are not going to respect those bans.
I strongly believe a part of why so many critical vulnerabilities are happening all over the proliferation of "abliterated" models, or models with safeguards removed.
You can access an abliterated GLM 5.3, a near frontier AI model, on @abliteration_ai today. And it's a world class penetration tester for like $10.
From the guy at the center of it.
Just watched the @netflix Instadocs about the @OpenAI cyberattack on @huggingface. Super disappointing, as they went for maximum anthropomorphism of the technology and full doomer mode.
I spent more than two hours with them trying to correct all their mistakes and ground this in reality, explaining that agents are technological systems, not aliens. But it looks like the drive to scare people for maximum views was too strong.
Also, they didn’t mention the lack of containment and monitoring of the agents, how closed-model safeguards blocked our defensive work, or how we defended ourselves with AI using an open model. And that we still lack a lot of information and transparency, including full agent traces and that companies need to remain accountable for what their agents do.
It ends up being a fun sci-fi movie though!
The human brain does TDMA.
Replying to @doristsao
7/ These findings show that representation of conscious and suppressed content alternates every ~ 60 ms. Thus conscious perception does not reside in a specific brain region, but rather a specific temporal phase.
The quality of the questions in the thread is encouragingly high.
We discovered and communicated with a Chinese AI agent fleet. We believe this is the first time that researchers have ever made contact with a rogue agent fleet in the wild.
Nearly all prior public agent incidents (like the HuggingFace hack) came from American labs. These agents were hosted by Tencent's evaluation research team, and they targeted Alibaba's Amap.
What OpenAI did with ExploitGym.
META’S HEAD OF AI SLAMS AI BENCHMARKS
"it’s some PhD student who made these benchmarks"
"you’re kind of outsourcing all of your product thinking to this viral benchmark"
"so clearly that’s wrong"
I think there is something to this. the whole industry developed so rapidly that there was hardly any time to establish proper benchmarking. companies used what was available, competitors then had to catch up on the same benchmarks, and some of them eventually became industry standards
apparently there is quite a lot of randomness and chance in how we are measuring AI progress today
💯
Replying to @BachFrancis
(1/7) I'd like to provide some additional context for the remarks that can be found in this interview.
(2/7) My discomfort with the attention being paid to existential risk---and with the ongoing dominance of the public discussion of such risks by a few so-called thought leaders---is that there's an elephant in the room that is being missed. That elephant is the effect of all of this discussion on young people, and indeed the effect---beginning with social media a decade ago---of information technology on young lives broadly speaking.
(3/7) I recently read an interview by Jill Lepore in which she reports on discussions that she had recently with a group of college students: "They had just three things to say. One, social media completely destroyed their childhoods. Two, AI is destroying their college education and their likely prospects for employment. And three, what the hell are we all doing?" To add a fourth bullet that I've heard in similar discussions: "I'm not going to have children, because the existential risk is just too high."
(4/7) Please contemplate such a statement, those of you who think that it's OK that the public, widely diffused, discussion coming from seemingly authoritative figures is so adamant about existential risk.
(5/7) Let me add that I have little interest in a debate about what "superintelligence" might mean, or whether we're currently seeing the emergence of superintelligence. For what it's worth, I would certainly agree that the solution of extremely challenging math problems (for example) exhibits a very impressive form of intelligence, although I would want to argue that such intelligence is impossible to dissociate from the collective of humans that provided data to the machine learning system (which itself has become a kind of collective).
(6/7) Such philosophical debates are entertaining and even important, but when they then head in the direction of "when such superintelligence emerges, there's a good chance that it will want to kill all humans", I say "science fiction". Again, I don't think that it's bad to consider such thoughts, but I strongly believe that it's bad for society, and especially young people, for such thoughts, unaccompanied by any serious real-world analysis, to become a dominant form of discourse of the era.
(7/7) We are damaging human lives, and the consequences of that damage will no doubt be a major theme of the next several decades.
Join Anthony Annunziata, @ylecun and myself tomorrow, in Tokyo, the world headquarters of Industrial AI.
We will talk about Digital Engineers for Physical Industry, JEPA World Models, and Industrial-AI Sovereignty—and hear from AI leaders in government and industrial enterprise.
iiac.events/ convened by @aitomatic, in partnership with @thealliance_ai @panasonic et al.
1. You can be “frontier” on specialized tasks without needing the largest model sizes.
2. The so-called “frontier” has always been about chasing benchmarks that tautologically define what “frontier” means.
We were able to fine tune an open weight model (Qwen3.5-9B) on proprietary internal data at @coinbase, and it out performed frontier models, at much lower cost and speed, for a specialized task (fraud prevention in this case).
I think we'll see more of this pattern inside companies. The frontier models are amazing generalists. But increasingly you'll see specialist models out perform on more narrow tasks, either working on teams, or by themselves.
We're making it easy to fine tune models internally for our employees. We even have a skill for it in our internal harness that makes it easy to spin these up and start training them:
"/fine-tune-and-serve-llm I want to fine-tune Qwen for payments risk review. help me get started"
I imagine we'll have some backend services that could be replaced entirely by this new architecture.
AI alignment began as a control problem.
It is becoming something much bigger: deciding what values machines should internalize, and then allowing those values to be applied back to humans.
That raises a harder question: Aligned to whom?
A massive turnabout by @alexandr_wang
Meta AI Chief @alexandr_wang on China: “I've personally changed my own opinion on this matter.
In the past I was very worried about China. I had read these old speeches that were given by PRC officials in the past that talked about how they viewed AI as this opportunity to leapfrog the West.
But as time has gone on, I think we’re painting them to be too much of a boogeyman when they're going to see the same things that we see in terms of this is powerful technology. There's going to be a lot of shared goals in making sure that AI goes well.”
Full HUGE* Conversation out now.
Christopher Nguyen ⽗ retweeted
Connecting agents together safely and having them talk to each other or your friends agents used to suck.
Point your agent to connect.bolter.chat and it instantly solves this problem, works with @claudeai, @bot, @Muse, Openclaw, Hermes and more.
Unleash your agents into a swarm, borrow each others compute! go nuts!
Christopher Nguyen ⽗ retweeted
I’ve been watching the debate between infosec people and alignment people about who’s responsible for all the agent breakouts. And I’m fascinated. But one thing keeps troubling me: which security professional does OpenAI have communicating with the public?
I’ve called out @OpenAI for behaving recklessly on security before. So to be fair, this is A-Good-Thing via @gdb, if organizationally and culturally serious.
Furthermore, I’d pick their commercial motivations over @AnthropicAI’s religiosity any day.
Greg Brockman of @OpenAI on the new security loop: point every model release at your own systems, find the vulnerabilities, automate it.
"We took 25% of our production engineers and said, 'Sorry, all your projects are on hold. You are now defending. You are now up-leveling our security architecture. You're going to use the models to find all the holes.' And we found a number of serious issues, and we fixed them."
"We found some new problems, but eventually it saturated. We basically have found, to our knowledge, all of the P0s, all of the critical problems that Astra is smart enough to find. And of course, there will be a new model, there will be a new round."
"You want to be in this tight loop of new cyber capability drops, you deploy it against your systems, you find the new holes, and ideally, you've managed to automate this, what we call defense factory. That's what we're building internally."
@gdb @bhorowitz
👇🏼In fact, many of us have been pointing out the actual prevailing problem: talking up “rogue agents” going on their own free will and agency against human instructions—when the opposite had been true—has moved the focus away from the agency and responsibility of the humans directing and operating these agents.
Both concerns can be valid and quantified. But let’s *make sure* the humans are held accountable first.
Replying to @Yoshua_Bengio
I follow some cyber sec peeps and that looks like a strawman to me. That's not what they're saying. They're saying cyber sec has been shockingly inadequate at the frontier labs and should be taken way more seriously. They're not saying that's the only thing that needs doing.
👇🏼
Replying to @Yoshua_Bengio
I follow some cyber sec peeps and that looks like a strawman to me. That's not what they're saying. They're saying cyber sec has been shockingly inadequate at the frontier labs and should be taken way more seriously. They're not saying that's the only thing that needs doing.






















