Pinned Tweet
Noeri is my seventh company, @noeri_ai. Here is why I started it with @YejinChoinka
I love building tools that people use every day, like XGBoost. Lately, I keep seeing the same moment. Last week, it was my young daughter. She described what she wanted to an AI coding agent and watched it come to life. She lit up.
It's joy, and it's wonder. I call it the joy of empowerment.
But that joy stops at using AI. A handful of labs create it. Most people rent it.
We started Noeri so the craft of creating AI belongs in every hand: self-improving AI that you control. It learns continually on the job, on your problem. You create it. You own it.
Many minds, not one.
Imagine the joy of empowerment with your own self-improving AI.
Through my wonderful time at NVIDIA and Stanford, one question has kept me up at night:
Should the future of AI be monolithic or plural?
To answer this question, we’ve raised $110M to get started, backed by @MenloVentures, @MadronaVentures, @NVIDIA, @NEA, @KindredVentures,@Wing_VC, @aixventureshq, @Cisco, @Snowflake, among others.
Today, Carlos (@guestrin) and I are stoked to launch Noeri, a neolab to push the frontier of plural intelligence.
Noeri means “the plural of intelligence” or many intelligences.
The future of AI we root for is plural: a healthy ecosystem of many intelligences, in all sizes, strengths, and quirks.
Discovery, in particular, has always been plural: many curious minds, each devoted to their own question, often on roads less traveled.
Our path there is self-improving AI that:
-> learns continually on the job, closing the gap between what AI can do off the shelf and what the dynamic world demands
-> learns to use other AIs as tools and make new tools to overcome its own limitations
-> picks the right-sized model for your problem, at a fraction of the frontier cost
Then the power of intelligence, from the craftsmanship of making AI to ownership, can be in the hands of all.
@noeri_ai mission reflects who we are as the founding team. My career has been anything but linear, literally continual learning on the job. Carlos has devoted his career to building tools that empower people through AI.
We are all a bit contrarian, a bit adventurous, and above all, big believers in pluralism.
Join us to build this future together: noeri.ai/
There's a new version of this post
Bloomberg on why @YejinChoinka and I started Noeri.
When one provider defines intelligence, its blind spots become the world’s blind spots. We want the opposite: many intelligences, and self-improving AI that you control.
Thank you @dinabass for telling the story.
Nvidia, Menlo, Madrona and Cisco are backing Noeri, cofounded by two prominent Stanford AI scientists -- Yejin Choi and Carlos Guestrin. The company is working on self-improving AI for enterprise and science markets that can be custom and cost-efficient
bloomberg.com/news/articles/…
THE JOIN is the largest open collection of databases to train foundation models! We also show that it enables very effective pretraining and zero-shot generalization with RT-J. There is now a path to scale relational transformers!
Introducing 💥RT-J💥, a System 1 model for Data
Science: put raw data in context, predict in one forward pass⚡No feature engineering, no model training, just accurate predictions.
Excited to release models, pretraining data+code and NeurIPS paper under the Stanford Tabular and Relational (STAR) ecosystem (links in comments).
How did we build this? 👇🧵
With SDPO, you can now do RL with natural language feedback, like error messages from coding environments or LLMs as judges. You can achieve huge gains over GRPO with scalar rewards!
Carlos Guestrin retweeted
I don't think people have realized how crazy the results are from this new TTT + RL paper from Stanford/Nvidia.
Training an open source model, they
- beat Deepmind AlphaEvolve, discovered new upper bound for Erdos's minimum overlap problem
- Developed new A100 GPU kernels 2x faster than the best human kernel
- Outperformed the best AI coding attempt and human attempt on AtCoder
The idea of Test Time Training is to train a model *while* it's iteratively trying to solve a task. Combining this with RL like they do in this paper opens up the floodgates of possibilities for continual learning
Authors: @mertyuksekgonul @LeoXinhaoLee @JedMcCaleb @xiaolonw @jankautz @YejinChoinka @james_y_zou @guestrin @sun_yu_
By specializing the model to each hard task using a simple entropic objective and RL, TTT-Discover writes new high-performing GPU kernels and improves open mathematical bounds.
How to get AI to make discoveries on open scientific problems?
Most methods just improve the prompt with more attempts. But the AI itself doesn't improve.
With test-time training, AI can continue to learn on the problem it’s trying to solve: test-time-training.github.io…
10
1,697
Relational Transformers provide zero shot predictions for complex databases!
Transformers are great for sequences, but most business-critical predictions (e.g. product sales, customer churn, ad CTR, in-hospital mortality) rely on highly-structured relational data where signal is scattered across rows, columns, linked tables and time.
Excited to finally share what I have been working on over the last year: a Foundation Model architecture which brings the power of Transformers to relational domains, enabling large-scale pretraining and zero-shot generalization in enterprise settings. 🧵1/n
TTT-E2E compresses the context simply through end-to-end test-time training — outperforms the loss of transformers with full attention, and achieves constant-time latency per token.
LLM memory is considered one of the hardest problems in AI.
All we have today are endless hacks and workarounds. But the root solution has always been right in front of us.
Next-token prediction is already an effective compressor. We don’t need a radical new architecture. The missing piece is to continue training the model at test-time, using context as training data.
Our full release of End-to-End Test-Time Training (TTT-E2E) with @NVIDIAAI, @AsteraInstitute, and @StanfordAILab is now available.
Blog: nvda.ws/4syfyMN
Arxiv: arxiv.org/abs/2512.23675
This has been over a year in the making with @arnuvtandon and an incredible team.
The Relational Transformer (RT) provides strong zero-shot predictions from relational data, e.g., databases.
Transformers are great for sequences, but most business-critical predictions (e.g. product sales, customer churn, ad CTR, in-hospital mortality) rely on highly-structured relational data where signal is scattered across rows, columns, linked tables and time.
Excited to finally share what I have been working on over the last year: a Foundation Model architecture which brings the power of Transformers to relational domains, enabling large-scale pretraining and zero-shot generalization in enterprise settings. 🧵1/n
1
12
1,759
SAIL Postdoctoral Fellows is an awesome opportunity to collaborate with the amazing faculty and students in the Stanford AI Lab!
SAIL is still accepting applications for the SAIL Postdoctoral Fellowships! This is an opportunity to work with our wonderful professors and community. Applications received by the end of April 30 will receive full consideration: ai.stanford.edu/postdoctoral…
The SAIL Postdoctoral Fellowship is a fantastic opportunity for recent PhDs to do their most innovative and impactful AI research, while being part of a highly collaborative and welcoming environment at Stanford.
Stanford AI Lab (SAIL) is excited to announce new SAIL Postdoctoral Fellowships! We are looking for outstanding candidates excited to advance the frontiers of AI with our professors and vibrant community. Applications received by the end of April 30 will receive full consideration: ai.stanford.edu/postdoctoral…
2
1,522
We are super excited to empower developers to focus on their goal of building innovative AI applications; we’ll take care of safety and security! What an awesome ride with Bo Li @uiuc_aisecure, @sanmikoyejo, @dawnsongtweets and the whole @VirtueAI_co team!
This Post is from an account that no longer exists. Learn more
Carlos Guestrin retweeted
Excited to share our release of LOTUS 1.1.0, which now makes it easier than ever to get started with LLM-powered data processing over a variety of custom knowledge sources.
Seamlessly connect to data from the web, your SQL databases, vector databases and more.
And process it all with the power of semantic operators.
github.com/lotus-data/lotus
Carlos Guestrin retweeted
SAIL is delighted to announce Carlos @guestrin, the Fortinet Founders Professor of Computer Science, as the next Director of @StanfordAILab. Carlos is a talented researcher and leader, known for his work on explainability, graphs, compilation, and boosted trees in AI.
Carlos Guestrin retweeted
We've been building LOTUS at Stanford and Berkeley to make LLM-powered data processing fast, easy and declarative.
LOTUS is an open-source query engine that makes programming as easy as writing Pandas and optimizes your programs for up to 400x speedups.
To celebrate the holidays, we're excited to share our release of LOTUS 1.0.0 with a batch of new updates that make reasoning over your data faster, easier and better than ever!
Code: github.com/guestrin-lab/lotu…
🧵👇
Carlos Guestrin retweeted
Can interpretability help defend LLMs? We find we can reshape activations while preserving a model’s behavior. This lets us attack latent-space defenses, from SAEs and probes to Circuit Breakers. We can attack so precisely that we make a harmfulness probe output this QR code. 🧵
Carlos Guestrin retweeted
🧵LLMs are great at synthesizing info, but unreliable at citing sources. Search engines are the opposite. What lies between them?
Our new paper runs human evals on 7 systems across the✨extractive-abstractive spectrum✨for utility, citation quality, time-to-verify, & fluency!
Carlos Guestrin retweeted
Super excited to share our work on LOTUS, a query engine for reasoning over large corpuses of data with LLMs!
Joint work w/ the amazing @sid_jha1, @matei_zaharia & @guestrin
Read the paper: arxiv.org/abs/2407.11418
Try out the code: github.com/stanford-futureda…
🧵👇
Carlos Guestrin retweeted
Prior work has used LLMs to simulate survey responses, yet their ability to match the distribution of views remains uncertain.
Our new paper [arxiv.org/pdf/2411.05403] introduces a benchmark to evaluate how distributionally aligned LLMs are with human opinions.
🧵
Carlos Guestrin retweeted
Many providers offer inference APIs for the same models: for example, there were over nine Llama-3 8B APIs in Summer 2024. Do all of these APIs serve the same completion distribution as the original model?
In our new paper, ✨Model Equality Testing: Which Model is This API Serving?✨, we formalize this question as a two-sample distribution testing problem: the user collects samples for their task from the API and a reference distribution, and conducts a statistical test to see if the two distributions are the same.
We design tests which show nontrivial power in detecting when models have been quantized, watermarked, or finetuned! (🧵 1/5)

























