In 2022, Berkeley PhD student Woosuk Kwon thought he could make Meta's new open-weight model, OPT-175B, run faster in two weeks.
Four years and 3,000 contributors later, that project is @vllm_project, one of the largest open-source inference engines, running on ~500,000 GPUs at any given time.
He and fellow researchers Simon Mo, Kaichao You, and Roger Wang borrowed "virtual memory" from operating systems, handing out memory only as it's needed so each GPU can juggle requests of wildly different sizes. (The "v" in vLLM is for virtual.)
Their first user, Berkeley neighbor @arena, cut its GPU needs in half. Today Google, Amazon, and Meta all run vLLM in production.
In January, the core maintainers founded @inferact and raised $150M to give vLLM a full-time team.
They're hiring across eng, marketing, and devrel in SF and Singapore: a16zjobs.substack.com/p/infe…
@simon_mo_ @woosuk_k @KaichaoYou @rogerw0108
F.D.Grillo retweeted
Ken Griffin’s historic gift of more than $3 billion will strengthen Carnegie Mellon University in Pittsburgh and establish Carnegie Mellon University Miami, advancing education, discovery and opportunity. #CMUMiami
Read more: cmu.is/griffin
F.D.Grillo retweeted
Announcing a solution to the Navier-Stokes problem, one of the seven Millenium Prize problem.
Represents a major milestone for both AI and mathematics, as well as pointing to an upcoming renaissance in scientific discovery.
Hoping that the knowledge created by this model can help the community better understand non-linear PDEs, which are used to model much of the physical world.
We’re sharing a solution to the Navier-Stokes Millennium Prize Problem, one of the deepest problems at the frontier of mathematics.
The proof was produced by a group of agents, using an OpenAI next-generation model significantly more capable than GPT-6 Astra.
The problem concerns whether the description of smooth three-dimensional fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for roughly 90 years.
F.D.Grillo retweeted
The human brain is astonishingly efficient. It runs on about 20 watts, roughly the power required to keep a dim bulb lit. Why can’t computers do the same?
Neuromorphic computing tries to answer that question by building hardware inspired by how networks of synapses process information. While this approach can reduce energy use, it often comes with a tradeoff in computing speed.
At SFI, a recent working group brought together experts in neuromorphic computing and stochastic thermodynamics to learn from one another and exchange ideas. By connecting device design with the underlying physics of computation, participants began to explore new ways to think about energy, speed, and randomness in computing systems.
santafe.edu/news-center/news…
F.D.Grillo retweeted
Sincerity used to be the default. Movies committed to their emotions and trusted the audience to meet them there. That belief made them feel real. So many films now hedge with irony or tonal whiplash, afraid to stand still and mean something.
F.D.Grillo retweeted
"Slowly, I realized realism in cinema is not the same as realism in life. Cinema has its own realism. The world in cinema is not the real world. It has been crafted. That makes cinema interesting. It's not real. It's closer to dreams. If you treat life as a dream, you can understand this."
Tsai Ming-liang
F.D.Grillo retweeted
just accidentally closed a tab i've had been meaning to read for the past 2 years
F.D.Grillo retweeted
LIVE: We're launching a new ride to the @Space_Station! @NASA_Astronauts Butch Wilmore and Suni Williams are scheduled to lift off on @BoeingSpace's #Starliner Crew Flight Test, riding aboard a @ULALaunch Atlas V rocket, at 10:52am ET (1452 UTC). teapawt.net/i/broadcasts/1dRJZElqL…
F.D.Grillo retweeted
This is Japanese diplomat Chiune Sugihara and his wife Yukiko. They spent 18-20 hours a day writing and signing transit visas by hand in Lithuania for thousands of Jews for 29 days from July 31 to August 28, 1940.
Yukiko described their last days in Lithuania: "He was so exhausted, like a sick person. Even though he was ordered to go to Berlin, he said he couldn't make it to Berlin and suggested we go to a hotel and rest before leaving. When we got to the hotel, the Jewish people came looking for us there. So he wrote some more visas in the hotel.
The next day when we got to the train station, they were there too. So he wrote more visas on the platform until the train left. Once we were on board, they were hanging on the windows, and he wrote some more. When the train started moving, he couldn't write anymore. Everyone was waving their hands. One of them called out, 'Thank you Mr. Sugihara, we will come to see you again,' and he came running after the train. I couldn't stop crying. When I think about it, even now, I can't help crying."
As the train left the station, Sugihara said, "Please forgive me. I cannot write anymore. I wish you the best." It is estimated that the actions undertaken by him and his wife are responsible for the present lives of around 100,000 people.
After the war, Sugihara was forced to resign and work menial jobs (selling light bulbs door to door). He languished in relative obscurity until 1968 when an Israeli diplomat managed to find him and finally got him the recognition that he deserved.
Sugihara never told anyone what he had done during the war. Even his closest friends had no idea. "I may have disobeyed my government, but if I didn't, I would be disobeying God. In life, do what's right because it's right, and leave it alone."
F.D.Grillo retweeted
Please contribute to improving the accuracy & context of information on this platform!
With yesterday’s admission of 18 new countries, we now have Community Notes contributors in 44 countries around the world. This includes the whole 🇪🇺
Welcome new contributors in 🇧🇬Bulgaria, 🇭🇷Croatia, 🇨🇾Cyprus, 🇨🇿Czechia, 🇩🇰Denmark, 🇪🇪Estonia, 🇫🇮Finland, 🇬🇷Greece, 🇭🇺Hungary, 🇮🇸Iceland, 🇱🇻Latvia, 🇱🇹Lithuania, 🇲🇹Malta, 🇳🇴Norway, 🇵🇱Poland, 🇷🇴Romania, 🇸🇮Slovenia and 🇸🇪Sweden! 👋
F.D.Grillo retweeted
"One person of integrity can make a difference, a difference of life and death."
When Elie Wiesel died #OTD seven years ago, the world lost one of its strongest advocates for Holocaust memory. He devoted his life to fulfilling the promise of Never Again.
Elie Wiesel
F.D.Grillo retweeted
Lonnie Johnson, a Black scientist employed at NASA in the early 1980s, was engaged in a project related to jet pumps. In a fortuitous accident, he inadvertently directed a stream of water across the room, sparking a brilliant idea for an innovative water gun. This led to the creation of the immensely popular Super Soaker.
To assess the viability of his creation, Johnson conducted an initial evaluation, comprising himself and his seven-year-old daughter. Her exuberant delight provided unequivocal confirmation that the water gun possessed immense potential. Subsequently, from the early 1990s onwards, the Super Soaker became a ubiquitous source of summer amusement for children throughout the United States. Moreover, this invention propelled Lonnie Johnson into the ranks of multimillionaires.
F.D.Grillo retweeted
AI + Twitter + twitter spaces transcription + Etherscan + other public social media + web + search engines + metadata = near real time tethering of personal identifying information to Web3 transaction activity at low cost.
F.D.Grillo retweeted
Want success in your career?
Be a doer, not a talker.
Don't just dabble or organize.
Take risks and commit to your convictions.
"History belongs to the doers." — Sam Altman
F.D.Grillo retweeted
The bill to ban TikTok is absolutely terrifying. It gives the government the ability to go after anyone they deem as a national security risk at which point they can access everything from their computer to video games to their ring light.
This is a Patriot Act for the internet.
F.D.Grillo retweeted
Time for Congress to get involved & create predictable rules so blockchain and crypto innovators have guidance on legal compliance. Chilling innovation without a future path for growth is economically unwise. CFTC Sues Binance in Chicago Federal Court wsj.com/articles/cftc-sues-b…



































