Illuminate the future.

Bay Area
Joined May 2016
Guodong Zhang retweeted
people change the world together, and we built boba to help. excited to finally share it publicly. one analogy i've liked for how the model learned to be good at interacting with people is learning from thousands of years of dreams it should feel pretty different already, but lots more to improve and lots of cool discoveries went into making this happen, some more of which we'll be sharing in the coming weeks
Introducing Boba - the social intelligence that understands your goals and your community. Text Boba today or message it online at boba.app
7
10
102
4,423
Guodong Zhang retweeted
Today we are releasing JST-2, the world's first full-stack physics-native world foundation model. Many world models learn in pixel/video space. We went back to first principles and built the entire model stack in 3D. Generate a 3D scene in seconds and expand it in real time. Create characters with motion built in, all through one general architecture.
292
356
358
2,279
1,711,126
The story of meta coming back here is epic and encouraging, happy for my friends at MSL / TBD. The game is far from over and now more players in the game, happy for the AI industry as well.
Introducing Muse Wonder, our new family of frontier models with state of the art performance for personal and professional agentic work.
5
1
160
10,310
Ultimately, there are ups and downs, and there are hard times. There is no such thing as failure, only giving up on yourself.
1
18
1,571
🤯
about 3 years ago, micro1 lost 60% of its revenue overnight and almost went bankrupt. today, i'm proud to share we've surpassed $1B annual run rate while remaining historically profitable. it’s been a special journey. we’re grateful for every struggle, moment, and person who has been part of it. we've taken a very untraditional path to get here. our core team is only ~180 people, spanning 14+ countries, and fully remote. many of our decisions sacrifice hundreds of millions of revenue and slow us down short term. but we believe they compound into advantages that are impossible to replicate long term. the long term is now. these are the 8 principles that made micro1 a leader in the data industry and will soon make us number one: 1.) human 1st AI: treat the tens of thousands of experts helping train models with absolute best-in-class care. our goal is to make AI training one of the largest, highest paying, and most enjoyable job sectors in the world. 2.) U.S. first: we refuse to work with adversarial nations, or export data that improves models against the interests of Americans. 3.) long-term research over short-term ARR: invest in deep research, products, and infrastructure for years from now, not just the next customer pipeline. 4.) proper incentives for intensely hard work: no arbitrary requirements like 996. inspire people to work extremely hard with outlier incentive structures instead of forcing weekend work. we’ve maintained close to 100% core team retention as a result. 5.) stay lean and global: we’ve reached $1B run rate with ~180 people, and intend to slow team growth significantly from here. exceptional talent is found around the world, and pedigree is the wrong thing to over-index on. 6.) execution alignment: company to retain a streamlined board so we can optimize for the next several decades, remain light-weight and dynamic, and take bold & calculated risks. 7.) abundant intelligence improvement: invest in building data generation models to make high-quality datasets and RL environments dramatically less expensive and more abundant. 8.) scale data on realism and horizon: realism brings the complexity of the real world into training models, while horizon extends how long models can work and how much complexity they can handle. both have enormous room to scale, and we’re pushing the limits of both. additionally: after surpassing $500M run rate this summer, we priced our Series B at a $4B valuation, alongside a ~$25M tender to give our early employees liquidity as we build for the long term. the round was led by Dream Ventures, a longtime supporter and one of our earliest investors, alongside Microsoft, Javelin, Flybridge, G Squared, Up Partners, and LG. we’re also grateful to be backed by incredible industry leaders, including Guodong Zhang (co-founder of xAI), Andy Fang (CTO of DoorDash), Igor Babuschkin (co-founder of xAI), Behnam Neyshabur (founder of Mirendil), Jerry Tworek (ex-VP of Research at OpenAI), and many more. data is on its way to becoming the largest industry humanity has ever seen, and we're certain this is just the beginning. best, Ali
1
52
6,010
Very much agree! first step could be switching all important softwares to Rust
The biggest impact of mathematics won’t be the millennium problems but proofs in general software at the scale. I think all mainstream software will be verified by 2030. You likely won’t touch an unverified library. Some of the biggest hurdles such as formalization of specs and doing this at 1B LoC scale are the ripe targets for auto research/self-improvement loop. The reason we can say this confidently is because either AI will get paused or the world will end if this doesn’t happen.
3
1
44
10,637
Very impressive with only 1,300 H200s
We built high-throughput materials labs in Menlo Park to create a loop between experiments and models. The labs generate fresh data, the models learn from it, and then help us decide what to try next. Using only 1,300 H200s, plus months of our experimental data, we mid-trained and RL’d an open-source model to surpass GPT-6 Astra on our analysis benchmark. We call it Neon. This is real footage from our lab. We’re focusing first on hard problems in materials science, including superconductors, magnets, and semiconductor materials. Read our blog posts below.
4
90
15,372
Congrats on the model launch!
For AI to work with us, it needs to understand us Today, we're introducing Persimmon, the first large-scale model designed to realistically simulate how people talk and interact
3
1
38
8,881
intelligence revolution is here, but game is far from over and more importantly it is a non-zero-sum game.
2
1
2
87
8,106
Guodong Zhang retweeted
Today we're launching Miles v0.1, an open-source RL framework for LLMs and multimodal models. RL training is easy to start and hard to debug. Miles helps you ensure your run is correct, use hardware efficiently, and keep RL running at scale. Over the past 9 months, 72 contributors have landed 1,326 commits, 85 GPU E2E CI tests, battle-testing Miles on frontier open models like Kimi K3, DeepSeek V4, Qwen 3.8, GLM 5.2, Inkling, MiniMax H3, etc. Miles powers frontier-model development and production RL workloads at @humansand, @periodiclabs, @modal, @DecagonAI, @Eigent_AI, @nebiusai, @IBM and more, on both @NVIDIAAI and @AIatAMD hardware. Here is what we built, and why teams picked Miles🧵
59
149
72
995
668,950
Guodong Zhang retweeted
1/ big announcement today: we will be releasing an open weight version of muse spark 1.2 soon. we also are releasing muse glimmer, a 30B agentic model with open weights under apache 2.0. muse glimmer can run on 24GB of VRAM without losing agentic reliability. 🧵
387
723
276
9,513
1,384,017
Human’s language is linear and autoregressive, but alien’s language may like a ring - diffused
17
1
66
11,358
We had a job post exactly “hardcore engineers”.
CRACKED ALERT: The startup powering @sgl_project, @radixark, has some of the most hardcore engineers in inference. They power production at @xai and at many Chinese labs.
2
57
18,551
Congrats on the amazing team and great mission!
Announcing Discovery Loop! I am very excited to announce that, along with my longtime friends and collaborators @Sanjay_Ghemawat, @OriolVinyalsML and @quocleix, we are founding Discovery Loop (@DiscoLoopAI), a Public Benefit Corporation whose mission is to automate machine learning, science, and engineering to accelerate discoveries and progress. The four of us have worked together for 14 to 30 years, and have helped build some of the world’s most used products, infrastructure and AI models, and we’re excited to turn our attention to this ambitious endeavor. ♾ Learn more at: discoveryloop.com
1
67
7,565
Guodong Zhang retweeted
Wow, it looks like Clippy will get ~20% faster in the next Rust release. (22.4% on my machine for the same repos.)
13
20
4
560
32,140
Guodong Zhang retweeted
AI is a supersonic tsunami
3,501
4,070
774
44,853
8,944,682
Guodong Zhang retweeted
For my first post, I’m sharing a letter @NVIDIA signed on why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models. images.nvidia.com/pdf/Open-W…
15,984
29,272
10,950
171,465
66,498,223
Guodong Zhang retweeted
Today, SkyPilot is out of stealth. Building custom intelligence is now existential. We help frontier AI teams build intelligence faster by removing their biggest bottleneck: AI compute fragmentation. Frontier teams like @appliedcompute, @AbridgeHQ, @hippocraticai, @hcompany_ai, and @nubank already run on SkyPilot, with 10x faster time-to-intelligence and double-digit increase in GPU utilization. AI teams today get compute anywhere they can. They then firefight compute fragmentation across providers. Researchers burn time on workload setup. Infra gets paged when GPUs go down. Frontier teams build slowly even on the fastest compute. @skypilot_org turns your fragmented compute into one AI supercomputer, so you run frontier workloads faster. Many users manage 10,000+ GPUs across providers with SkyPilot. GPU hours consumption has grown 6x in the last 6 months. 1/ We're launching SkyPilot Platform — the AI compute platform for frontier AI teams to manage large GPU fleets and accelerate building custom intelligence. Optimized for fleet management, team governance, and frontier workloads — pretraining, post-training, multi-cluster serving, and sandboxes. SkyPilot open source users can switch to the platform with a server URL change. 2/ We've raised over $20M led by @Lux_Capital (@breeves08), with participation from @AmplifyPartners (@dauber, @lennypruss), @coatuemgmt, @FoundationCap (@ashugarg , @JayaGup10), @RaceCapital, @thehousefund, and top operators like @alighodsi (CEO, Databricks), @JeffDean (Chief Scientist, Google), @rauchg (CEO, Vercel), @amasad (CEO, Replit), @ClemDelangue (CEO, @huggingface) and more. We're hiring across Engineering and GTM to deliver the platform for the next decade of AI. Above all, I'm excited to be building with the incredible team we've assembled, along with my cofounders Zhanghao @Michaelvll1, Romil @bromil101, Scott, and Ion @istoica05. If you firefight AI compute, let's build.
79
70
50
416
178,719
Guodong Zhang retweeted
At humans&, we train models from the long-term impacts of their interactions with people. This requires prioritizing long-horizon multi-agent RL. We've developed and are excited to share an open-source, hardware-native 4-bit RL recipe, significantly accelerating training
14
148
30
1,157
281,153
Impatience sounds bad on one side but meanwhile sense of urgency actually a positive thing 😀 Two sides of the same coin
3
1
55
9,537