founding team @runrehearsals; prev @dartmouth, @dbrxmosaicai; acquired founder; recovering poker grinder

williamsburg
Joined March 2022
Daniel Katz 🇺🇸 retweeted
Should we do a blog on our internal eval infra 🤔
1
1
5
130
Daniel Katz 🇺🇸 retweeted
Can frontier models actually predict how real people behave? 🕺 Today, in collaboration with @RunRehearsals, we are launching Human Behavior Bench, the first public benchmark that tests whether AI can understand human preference and everyday decision-making. AI models have gotten increasingly good at coding, but knowing for whom to build is the next frontier of challenges for AI models to capture. Human Behavior Bench evaluates models on predicting real human behavior across health, entertainment, recreation, values, and consumption. To build this baseline, we gathered ground truth data directly from real people and evaluated models across a wide range of everyday scenarios: • Ground truth baseline: 1,244 US adults surveyed (June-Sept 2026) • Some cohorts are traditional demographic indicators such as age, income, and location • Other filters are behavioral e.g. GLP-1 patients and recent car buyers • 750 cases total (149 public / 601 private) across finance, health, recreation, values, and consumption • Scored using 1-TVD (total variation distance) Base models still have a significant gap to close to accurately predict human behavior by cohort. LLMs’ predictions tend to converge towards the mean, while the true distribution of human preferences vary greatly. Against a human noise ceiling of ~93, the current leaderboard scores are: Rehearsals’ Engram 1.0 (AI Twins) tops the leaderboard at 94.1%, followed by Gemini 4 Argon at 80.6% Claude Opus 5 at 80.2%, GPT-5.6 Sol at 79.5%.
39
34
10
364
22,732
Daniel Katz 🇺🇸 retweeted
We introduce Maple-Preview, an open-source 20B-A1B ternary-weight reasoning LLM, SOTA in its weight class. It solves IMO-level problems and runs at 200+ tokens/s on a Mac Mini M4, 5–16× faster than efficient models like Gemma 4, Qwen3.5, and gpt-oss. deepgrove.ai/maple-preview
129
236
71
2,176
283,670
Daniel Katz 🇺🇸 retweeted
We’re introducing imagination models: a new foundation model architecture that unlocks learning from internet-scale video. Our first imagination model, Photon-1, learned to use a computer by watching 18 years of screen recording video without action labels.
54
235
80
2,653
592,956
Daniel Katz 🇺🇸 retweeted
Also I saw @RunRehearsals swag too and you’re not gonna wanna miss it…
Ya know I wanna post pics of our @speedrun swag for AI faire tomorrow so badddd but I think I’ll keep it a surprise 👀👀 #SFTechWeek
1
5
17
3,169
Daniel Katz 🇺🇸 retweeted
1
3
1
7
482
Daniel Katz 🇺🇸 retweeted
Replying to @DavidZagaynov
One of the best ways I spent time in SF. Took one of my favorite pics doing this.
1
1
7
763
Daniel Katz 🇺🇸 retweeted
Discipulus Ventures and @NewNorthVC have officially convened for the Harvard Defense Tech Dinner. 🇺🇸🇺🇸
1
4
35
3,819