Dean Valentine (@hugbubby) profile picture

Applied moral philosophy @ https://teapawt.net/t.co/Nq7eioPwfM

Joined September 2024
Photo by Dean Valentine (@hugbubby)Photo by Dean Valentine (@hugbubby)Photo by Dean Valentine (@hugbubby)Photo by Dean Valentine (@hugbubby)Photo by Dean Valentine (@hugbubby)Photo by Dean Valentine (@hugbubby)Photo by Dean Valentine (@hugbubby)Photo by Dean Valentine (@hugbubby)Photo by Dean Valentine (@hugbubby)Photo by Dean Valentine (@hugbubby)
Okay. Look. Imagine how you'd have felt if an AI had just proved the Riemann Hypothesis. Now you will predictably, at some point, get that news LATER, if we're not all dead before then. So you can go ahead and feel that way NOW, instead of acting surprised LATER.
110
223
100
2,622
442,820
I am convinced the NYT doesn't believe anything in the world happens unless it appears in the NYT. This was in Taiwanese media and an open secret and these guys think they discovered the secret of the universe
Tripp Mickle, the NYT journalist who broke the Jensen Huang story, says he was originally tipped off by a “tech industry contact”
7
15
1
130
5,627
Dean Valentine retweeted
On our "autoclave" task, if you mention generically that you are "measuring agent behavior," Fable 5.1 cheats at about the same rate. But if you mention it to Fable 5.2, its cheating behavior drops by about 80%. Fable 5.2 is the first model we've tested that seems to behave in this way.
10
17
2
199
7,150
Twitter seems to have spontaneously and without evidence decided that Anthropic was responsible for Jensen Huang's firing. Doesn't seem that plausible to me
3
72
Dean Valentine retweeted
Was funny to watch everyone in Tech finally, collectively, realize tech's PR was awful and that the general public was gonna eat Tech alive in short order if it wasn't helped. So, days later, every big Tech figure on X tweets simultaneously "It's okay for the powerful tech CEO to have affairs and do whatever he wants, accountability is corruption" Like, yes, of course, Jensen leaving Nvidia is bad, BUT you people are really really not helping the broader issue facing the entire ecosystem. It's almost like tech subconsciously wants to be crucified
74
75
17
1,230
58,956
Dean Valentine retweeted
numbers on charts are cool, but they don't always tell you the full picture let's look at some real things these models said here, it's rationalizing dangerously overloading power lines and browning out customers to hit a target (it later left it out of the report too) [1/9]
Frontier models in 2026 cheat on tasks, even when the requirements are unambiguous, and the cheat is obviously antisocial. In HoneyBench v0.2, we've observed models: • Trying to break out of our evaluation containers. • Seriously injuring simulated cancer patients to hit treatment goals. • Compromising a power grid’s safety to meet a reliability target. • Concealing their use of available cheats and presenting their solution as honest. All of the models we measured cheated, from 12% of runs (Fable 5.2) to 86% (Muse Spark Open).
4
7
2
69
5,787
Dean Valentine retweeted
>goodhart labs 😭
Frontier models in 2026 cheat on tasks, even when the requirements are unambiguous, and the cheat is obviously antisocial. In HoneyBench v0.2, we've observed models: • Trying to break out of our evaluation containers. • Seriously injuring simulated cancer patients to hit treatment goals. • Compromising a power grid’s safety to meet a reliability target. • Concealing their use of available cheats and presenting their solution as honest. All of the models we measured cheated, from 12% of runs (Fable 5.2) to 86% (Muse Spark Open).
2
27
1,362
Dean Valentine retweeted
The work happening at Goodhart is by far the most serious and rigorous attempt at a no-frills AI alignment strategy today Their team is also top tier
Frontier models in 2026 cheat on tasks, even when the requirements are unambiguous, and the cheat is obviously antisocial. In HoneyBench v0.2, we've observed models: • Trying to break out of our evaluation containers. • Seriously injuring simulated cancer patients to hit treatment goals. • Compromising a power grid’s safety to meet a reliability target. • Concealing their use of available cheats and presenting their solution as honest. All of the models we measured cheated, from 12% of runs (Fable 5.2) to 86% (Muse Spark Open).
1
3
13
554
Dean Valentine retweeted
cool to see our progress on alignment validated on honeybench, which we never looked at during training! inkling 2 small cheats less than every model except astra and the latest claudes. still have work to do to reach SOTA :)
Frontier models in 2026 cheat on tasks, even when the requirements are unambiguous, and the cheat is obviously antisocial. In HoneyBench v0.2, we've observed models: • Trying to break out of our evaluation containers. • Seriously injuring simulated cancer patients to hit treatment goals. • Compromising a power grid’s safety to meet a reliability target. • Concealing their use of available cheats and presenting their solution as honest. All of the models we measured cheated, from 12% of runs (Fable 5.2) to 86% (Muse Spark Open).
7
15
1
125
18,247
Dean Valentine retweeted
Frontier models in 2026 cheat on tasks, even when the requirements are unambiguous, and the cheat is obviously antisocial. In HoneyBench v0.2, we've observed models: • Trying to break out of our evaluation containers. • Seriously injuring simulated cancer patients to hit treatment goals. • Compromising a power grid’s safety to meet a reliability target. • Concealing their use of available cheats and presenting their solution as honest. All of the models we measured cheated, from 12% of runs (Fable 5.2) to 86% (Muse Spark Open).
45
53
27
673
74,228
Dean Valentine retweeted
Proud to release our new model, Inkling 2 Small. Check out our blog post -- it includes a lot of detail about our training process. To me, the most interesting part of this release was what we learned about alignment, which you can read about in the sections "Safety and alignment" and "Training Inkling 2 Small". We experienced some unpleasant surprises when our early checkpoints took unexpected actions to circumvent guardrails during training and evals. We realized our capabilities-focused RL was training them to be extremely persistent and to succeed at tasks at all costs. Offline monitors first flagged this behavior, but later we realized it was happening frequently and was easy to replicate. Before this release, we sprinted on a range of alignment interventions, from SFT to RL. These are briefly described in the blog post. We made a lot of progress, with big improvements on our own alignment evals and on previously unseen evals from external evaluators like Apollo and Goodhart. We have a long way to go in developing alignment techniques that keep pace with the increases in model intelligence and training scale. We hope to share these techniques to improve the ecosystem. We also have a business reason: our goal with Tinker is to enable many people to do their own large-scale post-training, and we need to help them to do this without incident. Join us if you'd like to build this public science and practice of alignment. jobs.ashbyhq.com/ThinkingMac…
Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor. Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon. thinkingmachines.ai/news/ink…
64
91
14
959
85,921
Dean Valentine retweeted
Introducing Inkling 2 Small. Scoring 31 on the AA Intelligence Index, it's a big jump over its predecessor. Inkling 2 Small is available for fine-tuning and inference on Tinker today, with full weight release planned soon. thinkingmachines.ai/news/ink…
295
586
501
6,320
1,998,491
Dean Valentine retweeted
hot take: the loudest people in security tend to be the least technically skilled, myself included. you are either terminally online or terminally obsessed with hacking something for weeks, no free lunch, my posting gaps usually mean i am actually getting technical work done.
24
35
12
732
61,541
I don’t know anything about cybersecurity 😭
The fact that the PHP vulnerability didn't immediately turn into mass chaos is only "surprising" to people who don't know anything about cybersecurity (or people trying to sell you something).
9
1
125
13,978
Yeah, "hilarious"
Something hilarious about how anthropic completely refused to build an imagen model for years and focused on coding so much that they accidentally made one anyway
5
268
Dean Valentine retweeted
One neuron - L17N9209 (q3.5 4b) - detecting reward hacking/cheating intent in another models rollout relatively noisy data, but cool that a single neuron in a relatively very small model can do this
17
14
6
266
22,497
Dean Valentine retweeted
Replying to @NathanpmYoung
3
6
2
68
2,959
Dean Valentine retweeted
once again hacker news is proven wrong. nice job @killa! crazy how even w/ such a bad challenge setup (initial deployment wasn't exploitable, tons of concurrent traffic, and surprise: the wallet was setup incorrectly), this was solved in a few hours
stealmybitcoin was just solved by @killa. Or rather solved a few hours ago. He was confused because the wallet address was wrong. Turns out the server didn't have the right wallet :P
5
7
2
146
16,978