Atem Aguer (@leithnyang) header
Atem Aguer (@leithnyang) profile picture
Joined December 2020
Photo by Atem Aguer (@leithnyang)Photo by Atem Aguer (@leithnyang)Photo by Atem Aguer (@leithnyang)Photo by Atem Aguer (@leithnyang)Photo by Atem Aguer (@leithnyang)Photo by Atem Aguer (@leithnyang)Photo by Atem Aguer (@leithnyang)Photo by Atem Aguer (@leithnyang)Photo by Atem Aguer (@leithnyang)Photo by Atem Aguer (@leithnyang)
The first AI programmer will be created within the next 1-3 years. It'll be an LLM exposed to a terminal. Unlike chatgpt trained for dialogue, it'll be trained to use the terminal to run commands, browse and edit files, and debug its own code. All the components are already here
2
4
1
33
Atem Aguer retweeted
How do you, like practically, run a 1000 agent swarm
49
3
1
85
12,020
Atem Aguer retweeted
Mechazilla catches Starship! Congratulations to the entire SpaceX team on this incredible achievement!
6,795
27,283
9,074
140,752
16,950,151
Atem Aguer retweeted
Watch Starship Flight 15 teapawt.net/i/broadcasts/2brajgZlO…
3,032
6,577
1,683
45,143
7,990,725
bullish!
A billion people produce the most valuable dataset in the world every day – and delete it every night. We’re recording it. Introducing @AttentionInc
16
2,291
Atem Aguer retweeted
Can coding agents stay coherent over a 1 billion token budget? Can they build Slack from scratch? Rewrite a JAX codebase in PyTorch? Build a C compiler in Rust? Enter SWE-Marathon: a benchmark for autonomous long-horizon software work.
48
67
37
700
835,249
anthropic about to cook with sonnet-5 midtrained via distillation pretraining on mythos
2025 was the year of rl. 2026 is the year of distillation
5
475
Atem Aguer retweeted
Starting today, personal superintelligence is just one tap away. No download, no signup. Text Poke for free now: Poke.com 🌴 — 0:00 – What's Poke? 0:50 – Introducing Poke Recipes 1:25 –  Create a Recipe in 10 seconds 1:43 – Earn on Poke 2:44 – Build with npx poke 12:58 – Recap 13:36 – Parisian Love
190
127
137
1,648
962,964
People keep saying 2026 will be the year of continual learning. But there are still major technical challenges to making it a reality. Today we take the next step towards that goal — a new on-policy learning algorithm, suitable for continual learning! (1/n)
51
221
33
1,523
245,421
Atem Aguer retweeted
Introducing 💡On-Policy Self-Distillation💡, a simple method that enables LLM to teach itself with dense per-token feedback on its own on-policy generations—achieving 4-8x more token efficiency vs. GRPO and outperforming both GRPO and SFT/Off-Policy Distillation. Key insight: like a student reviewing solutions, rationalizing them, and correcting prior mistakes, an LLM can be conditioned on privileged info (e.g., correct solution or a reasoning trace) and supervise its weaker self—the version without such access—by matching the privileged-info-induced distribution from itself. 🌐Blog: siyan-zhao.github.io/blog/20… 🧵👇
33
160
11
940
138,590
perfect time to contribute. skyRL tx is pioneering a unique approach to next-gen unified inference and training engines that will be critical for problems like continual learning
Happy new year! We are excited to announce SkyRL tx 0.2.1, see novasky-ai.notion.site/skyrl…. Some highlights of the release include FSDP and multi-node support, Llama 3 model support, custom loss functions, a number of performance improvements and also lots of small fixes that implement more functionality of the Tinker API. The blog post also includes a performance comparison with the Tinker Service! Enjoy the release and happy hacking!
3
312
Atem Aguer retweeted
Happy new year! We are excited to announce SkyRL tx 0.2.1, see novasky-ai.notion.site/skyrl…. Some highlights of the release include FSDP and multi-node support, Llama 3 model support, custom loss functions, a number of performance improvements and also lots of small fixes that implement more functionality of the Tinker API. The blog post also includes a performance comparison with the Tinker Service! Enjoy the release and happy hacking!
1
15
1
78
11,307
if you're already overwhelmed by the current progress in ai capabilities, remember that these growth rates are exponentials of exponentials. things are going to get crazy in 2026. exponential growths happen slowly and then suddenly, how about exponentials of exponentials
The current progress of AI development and research follows @raykurzweil law of accelerating returns(kurzweilai.net/the-law-of-ac…). Human beings already struggle with understanding or keeping up with exponential growth. And yet the current pace is an exponential of an exponential
2
249
software engineering -> context engineering; software engineer -> context engineer
1
209
how far things have come in 3 years. with this belief in mind, in early 2023, i designed a proto-claude-code called shoggoth (github.com/atemaguer/shoggot…)
The first AI programmer will be created within the next 1-3 years. It'll be an LLM exposed to a terminal. Unlike chatgpt trained for dialogue, it'll be trained to use the terminal to run commands, browse and edit files, and debug its own code. All the components are already here
1
6
496
What an incredible ride. I'm excited to announce that @codegen has officially been acquired by @clickup ! 🎉 I will join as Head of AI and the team + product will live on within ClickUp. We're all in on agents to build the future of knowledge work!
28
14
4
104
20,305
2025 was the year of rl. 2026 is the year of distillation
2
1
8
6,070
Replying to @brianzhan1
For small / custom models, you might want to try out github.com/NovaSky-AI/SkyRL/… which is open-source and is working quite well now. You can use your existing Tinker scripts and customize it however you like and the code is quite readable.
1
2
16
1,242