
Head of Eng @PsdnAI / UIUC CS / wanna-be AI frog
Seoul
Joined May 2020
- Tweets6.1K
- Following596
- Followers2.2K
- Likes13.8K
Jongwon π°π· @ CoRL retweeted
Swarms are quickly becoming one of the most important topics in Silicon Valley, sharing a few notes from recent conversations:
- The naive view of swarms is that theyβre a sum-of-parts method of parallelization / brute force, but weβre empirically seeing the βshapeβ of swarm intelligence be very different.
- The way swarms achieve this is through a combination of parallelization, entropy, and specialization, leading to emergent solutions that arenβt covered by a small number of brilliant frontier models acting as central planners.
- Itβs also not obvious that the economics of swarms follow higher cost = better output. Swarms that mix and match frontier and non-frontier models with different reasoning levels may be more economical than a small number of frontier agents, and broadly, there should be a new Pareto curve here.
- Swarms will be orders of magnitude more token-consumptive than agents, just as agents were compared to humans + models, further driving constraints in inference supply.
I think itβs important to build intuition here so have been running some experiments that Iβll share soon. A great way to get started with swarms is the /swarms command in the new google anti-gravity.
A few of the smartest thinkers on this topic are @alehandromz @jsnnsa @gokhan_egri @pirroh @amasad
Love to hear other POVs on swarms if folks have them!!
Swarm riders and Swarm-native companies
AI-use even among highly AI-native people is power-law distributed.
There seems to be a new class of people β call them βswarm ridersβ β who are capable of consistently commanding large swarms of agents to productive ends.
This is a new kind of managerial skill, analogous to the skill it takes to manage large organizations of people, but wholly different in nature and of course more technical.
Based on the swarm riders we know (including many at @Tempo and @Paradigm), these people are capable of productive token spend that is 1000x-10000x higher than median software engineers, and 100x higher than top 5% Claude Code users.
The art of swarm riding is different from software engineering and more akin to machine learning, where practitioners grapple with black box systems: defining reward functions and evals, transmuting non-verifiable problems into verifiable problems, running experiments, etc.
Swarm-native companies are a new class of company founded by and populated by swarm riders. These companies are organized around swarms in a way that conventional companies will struggle to replicate, as the cost of internal human coordination is sand in the gears of an effective swarm. Effective swarm-native companies will define the right reward functions and evals, remove functional and bureaucratic barriers, and then let the swarms cook.
Weβve gotten to see a few swarm-native companies up close β reshaping financial rails @Tempo, building a new gaming platform @Spawn, cyber swarms at Cathedral Systems β and itβs clear these teams wield a significant advantage over pre-AI teams.
Some questions Iβve been wondering about:
1) How fast will swarm riding diffuse through the economy? The implications for token spend could be significant.
2) Can swarms be effectively adopted by existing companies or will it generally track the formation of new swarm-native companies?
3) What becomes scarce as swarm capabilities themselves commoditize (through frontier models becoming better at swarming, swarm capabilities built into harnesses, etc)? Cultures and teams that can define reward functions well and otherwise get out of the way?
Data center construction is heavily bottlenecked by labor, doing so will make compute hilariously autonomous.
That's in addition to designing chips using AI. A lot of closed loop coming.
Sam Altman says OpenAI will aim its robotics program at building its own data centers.
Speaking on Stripe co-founder John Collisonβs Cheeky Pint podcast, he said self-replicating data centers are now βwithin graspβ: AI-controlled robots running chip factories and building turbines, solar panels and more data centers, to produce βa lot of really cheap compute.β
He argued robots could also make the parts that permits and supply chains hold up today, and said OpenAI already has its own chip and is learning to build its own data centers.
On the cost of AI, Altman said it takes about $70 billion to build and run one gigawatt of capacity for five years, and that $20 billion would make him βmuch happier.β
2
108
We will open source more data and research as we expand our capacity.
For researchers at CoRL, reach out for various data! Happy to collaborate on improving models with globally diverse datasets
Today, we're releasing EgoCrowd-500H, a new dataset accompanying our @corl_conf 2026 research on quality failures in crowdsourced egocentric video.
β’ 300 stereo clips
β’ 2.5 hours of footage
β’ 50 human-reviewed clips
Out now on @huggingface.
Continuous feedback during motion is a must.
@JitendraMalikCV says we must RL as if a parent teaches a child atomic skills with video and tactile.
Agentic robotic is a high-level policy to use fast "tools" - low-level atomic skills with semantic orientation.
The theme is "dexterity" at CoRL.
Most booths are humanoid hands and robot arms!
Cool hands from @origami_robo.
@PsdnAI is researching visuo-tactile WAMs with own video and tactile data. Reach out!
We're honored to present research at @corl_conf.
Our team studied 500 hours of crowdsourced egocentric video to better understand where data collection goes wrong, and how to improve quality control for Physical AI.
One key finding: 90% of footage in flagged clips falls outside labeled failure intervals. Rejecting entire clips can mean discarding a lot of potentially useful data.
Tremendous work by @iamrashminagpal, @sebliu, @jdubpark, and Sandeep Chinchali.
First look at our research poster below. Catch us tomorrow at the 'Oops, I Erred' #CoRL2026 workshop β΄
Fable 5.2 shows substantially improved skills in controlling physical robots, even on tasks it has never explicitly been trained to do.
On RoboDojo, a benchmark with a simulated two-arm robot, it outperformed other models and most AI systems built to control robots.
I see laptops and coding on every seat on Starlink-equipped flight SF to Austin right now π
3
192
Jongwon π°π· @ CoRL retweeted
MuJoCo 4.0 from Google DeepMind is the first major version of the physics engine since 3.0, three years ago. Its headline feature, speculative contacts, keeps thin and fast objects from passing through each other, which allows much larger timesteps.
The problem
β’ Collision detection checks geom poses only at discrete timesteps. A thin or fast object can move further than its own thickness in one step and tunnel through, so the usual fixes are a smaller timestep or an inflated margin.
How it works
β’ Speculative contacts: each fast-moving geom is swept forward through the step to find when it would hit something. The solver gets a contact like any other that stops the motion at the surface, with no sub-stepping.
β’ Deformables are now solved implicitly together with rigid bodies, joints and tendons, which keeps cables, cloth and shells stable at 5-10x larger timesteps. New are penetration-free cloth and elastic rods with bending and twist.
β’ Plasticity: wires, clay, folded paper and metal foil now keep their dents and creases.
Does it pay off?
β’ In the team's tests, an arm catches a 0.7 mm playing card falling at over 2 m/s with a 16 ms timestep every time, where discrete collision detection misses it above 8 ms.
β’ Humanoid stair climbing and thin-object grasping run 6 to 9 times faster, because they can use larger timesteps.
Also in 4.0
β’ MuJoCo Studio, a new viewer SDK with physically based rendering. The same tools run in a browser tab with nothing to install.
β’ MuJoCo Playground 1.0 ships alongside.
Caveats
β’ The speedups and timestep factors are the team's own measurements, without benchmark details in the announcement.
β’ Speculative contacts predict motion from pre-step velocities, so a slow geom pushed across an obstacle within one step can still tunnel. They cover convex primitives and meshes on CPU. Heightfields, SDFs, flexes, MJX and MuJoCo Warp are listed as coming next.
β’ Breaking changes: composite bodies, the cable and shell plugins and flexvert equalities are removed, Python 3.10 is dropped, and 3.x installs need a pip uninstall first.
By @yuvaltassa and the Google DeepMind Robotics Simulation Team.
MuJoCo 4 is released!
github.com/google-deepmind/mβ¦
Jongwon π°π· @ CoRL retweeted
GPT-6 Astra's robotic capabilities are not emergent. It was trained on robotics specific data. So were GPT-6.1 Sol and Gemini Argon
Here's how we know π§΅
hearing some chatter that anthropic is now lowering down to $1tn to get this IPO done. let me explain why this doesnt matter and its actually all over-
the entire existence of this company is based on a funding model that inherently has extreme asset liability mismatch. what that means is that just like the hyperscalers are diluting their equity fund capex, there is an expectation that anthropic will also have to do the same. ie it needs strong equity to perpetuate the scheme
but if you IPO at the wrong price (and dont get a pop which increasingly appears they wont be; spacex already below) then youre now in the death spiral that crypto investors should be very familiar with: its called the reflexivity trap of the confidence game. its the "ill bid FTT at $22 all day" or the "steady lads UST is $1" game, with all its lucid horrors. and here is the key insight- the confidence game exists at the service of the creditors. if there is no credit, there is simply no equity. and there is no credit, if there is no collateral
if the credit rating agencies are not going to give IG at $2tn, they are certaintly not going a better HY rating at $1tn. and there is no world in which anthropic can exist without credit because ~$1tn of commit, much of which is noncancellable, is a straight up negative equity pledge
yet there were two scenarios in which i was willing to concede anthropic could IPO: first 1) the improbable but possible was if the hyperscalers/chips oligopoly came to rescue and plug the hole, given their incestuous nature of revenue bookings and paper gains/losses at scale. but it is clear now that the market has spoken this will lead to a mutual death, and should not be attempted. or perversely even better, they are actually better off letting anthropic go to zero so they can acquire the pieces on the cheap which is the best nash equilibrium outcome, not just for the dominant player but for society at large. second 2) the us government can nationalize the company and collude with other sovereigns (like UAE, Saudi, Japan who are basically already the checks) to force its funding as a collective bargain. this gives you trillions, which is actually the most effective backstop to restore market confidence. the first edge case does require an IPO, but the second edge case here for which i believe there is still a good chance that this is the ultimate end game- will require a failed IPO to recapitalize at a normalized price for the consortium (and dont forget that openai front ran this investor group in anticipation of this dynamic to play out as a private co last month)
i believe the market is crapping out today because the market is recognizing it will not IPO. and actually, as ive said before, this is a very good thing. i might even imagine that the market could quickly rebound on the news of its IPO being delayed because it allows #2) to play out, as not only a national, but an international bailout. the US is more likely to tolerate, even relish, the taxes of foreginers to fund our domestic companies. that is the only end game that really matters, and the end game i am going to be excited to see
we'll see if this newly revamped washington can figure it out
we will need to rebuild and rewrite much of software to adapt to a new, faster pace.
code used to arrive one drop at a time. soon, if not already, code will be written as if it were a continuous stream, like a violent river twisting and turning as it pleases.
this is not a new thing: big tech cos have had to deal with this with the enormous scale of their engineering teams. but now ai has brought an incredibly elastic and capable workforce wielded by every engineer. this is your problem now, and the only way to adapt is to evolve your systems so agents - even and especially the ones with little context about the right way of doing things - can thrive. make the easy thing the right thing.
your codebase is becoming organic architecture. agent contributions grow around the constraints and guardrails youβve designed. good software engineering matters even more now! and no, the continuous stream of code is not something you have to watch helplessly. be more ambitious and design systems, frameworks, and languages to control the chaos.
the time for mourning coding is long over
Replying to @josephfcox
Here is Proton CTO's AI manifesto, that I obtained multiple copies of 404media.co/manifestos-fear-β¦
Path to IPO
Day 25/
We are doubling all usage limits for all Pro 100/200/500 tiers and Business Premium, effective today.
We heard your kind feedback and wonβt be reducing usage limits for Pro 200, so your Work and Codex usage will stay the same. Weβre also going to continue offering extended limits for dots for now, and usage of your dot will still continue to be separate from your default usage.
And we'll of course also keep shipping better models and other efficiency improvements that increase your effective usage over time.
1
172
There is an absolute barrage of inference providers popping up that get to $1M/mo extremely quickly.
This is the rough economics of inference providers:
Even if you rent on-demand B300s at $8/GPU-hr, many open source models (GLM 5.3, Kimi K3, DeepSeek 4.1 Flash / Pro) can get you >$10-20/GPU-hr at reasonable throughputs (100tok/s). DeepInfer from DeepSeek directly shows they can get $38/GPU-hr on off-peak hours. Every chip / model has a different throughput / interactivity curve, but there is a lot of arbitrage between even high rental spot prices and token prices. New chips (Vera Rubins) also change this meaningfully. Your ability to be making gross margin relies on your utilization and how good your stack is.
Gateways like OpenRouter, Vercel and more help solve that problem by aggregating demand to you. May inference providers discount their tokens to get longer term commits too. I've even heard stories of selling back Chinese model tokens to Chinese labs!
One thorn in the economics of these players is that many Chinese open source model labs are now asking for rev share if you're at a certain scale, espp for pre-release access to their models for day 1 support. That further pushes the threshold to be in the money.
The barrier to entry seems low and falling. There are even stories of smaller ones who can "vibe code" a way to stand up OSS models on a cluster they rent. And as a result, we're seeing 10s of such companies pop up almost every week and immediately skyrocketing revenue at low-ish gross margin and raising rounds on the back of that.
Unsurprisingly, because the actual service provided seems commodity, this eventually drives up compute prices and drives down token prices. In theory, it would seem like neoclouds who have the lowest cost of compute and themselves have started inference businesses would win the race to the bottom (Crusoe Coreweave Nebius and GMI all have inference businesses), with larger players (Modal Fireworks Baseten) being second because they are well capitalized to make bigger compute commits cheaply and have demand (high utilization), but the reality is the pie is growing so quickly that even upstarts are absolutely crushing it and growing aggressively (inference dot net, DeepInfra, Wafer, Relace, Morph).
Strategies vary across the board: neoclouds want to serve inference, inference players want to be neoclouds and do higher margin reserved instances / post training, and some want to go heterogeneous hardware or creatively flexible compute constructs.
The risks are: do open source models continue to be competitive? Will their creators rent seek more? Will their shape change compute needs? How do different chips change economics? Who gets compute in a supply crunch?
Below is a aggressive sketch of how gross margin scales with utilization for various models / chip sets.
For now, there are many inference providers and theyβre all ripping!





























