Rich Counts (@RichCounts) header
Rich Counts (@RichCounts) profile picture
New York, NY
Joined August 2009
Photo by Rich Counts (@RichCounts)Photo by Rich Counts (@RichCounts)Photo by Rich Counts (@RichCounts)Photo by Rich Counts (@RichCounts)Photo by Rich Counts (@RichCounts)Photo by Rich Counts (@RichCounts)Photo by Rich Counts (@RichCounts)Photo by Rich Counts (@RichCounts)Photo by Rich Counts (@RichCounts)
Rich Counts retweeted
Financial services: 8k in → 64 out; LFM2.5-350M on B200. During a credit application, the model evaluates applicant data alongside financial and risk signals and returns a structured eligibility or credit decision.
2
1
24
2,585
▲ Liquid AI just released RIPL, an inference engine that puts small LLMs directly in the request path of live production systems. The key idea is optimizing the whole path, from request arrival to the finished response, for tail latency under load. Liquid tested the same LFM2.5-350M model on vLLM and on RIPL, and RIPL's p95 stayed lower. So part of the gain is the engine, not only the model. On 1 B200, LFM2.5-1.2B on RIPL hit 34.6 ms p95 vs 498 ms for Qwen3.5-0.8B on vLLM (32 in, 32 out, 1,000 req/s). On 256 in, 128 out, the gap grew to 28.4x. It is a trade-off though: LFM2.5-2.6B reached 76.4 ms on the short workload, above the 50 ms headline, and every number is self-reported. RIPL is available now for enterprise LFM deployments on NVIDIA H100, H200, B200 and RTX PRO 6000. It is closed, serves LFMs only. Shopify already runs LFMs at sub-20 ms in production search...... Full analysis: marktechpost.com/2026/10/22/… Blog: liquid.ai/blog/low-latency Calculator: liquid.ai/low-latency-calcul… Models: huggingface.co/LiquidAI @liquidai @maximelabonne
5
14
32
1,820
Rich Counts retweeted
Today, we announce 𝙻𝚒𝚚𝚞𝚒𝚍 𝚁𝙸𝙿𝙻 (real-time inference pipeline), our ultra low-latency inference engine built to put LFMs directly in the request path of real-time workloads like search, ads, fraud, recommendations, and payments. > complete generated responses end-to-end in sub 50ms > maintains low latency under continuous peak load > LFMs get up to 20x faster on RIPL > RIPL supports Multimodal LFMs > RIPL supports d1, our decision models too! RIPL optimizes the full path from request arrival to a complete generated response. As traffic rises, its performance advantage is greatest on the slowest requests. Let’s see some production use cases:
30
122
29
1,120
112,997
Rich Counts retweeted
we've seen some cool use cases for our multimodal decision model family d1. here's a thread of a few of them 🧵
2
3
96
10,064
Rich Counts retweeted
Continuous sensing creates memory bottlenecks on edge devices. Qualcomm & @ramin_m_h, Co-founder and CEO of @LiquidAI are advancing on-device AI with Liquid Context on @Snapdragon — compressing multimodal inputs for fast, low-power execution.
8
13
3
67
11,713
Rich Counts retweeted
This is quickly becoming one of my favourite labs. Yesterday they also released a great 24b model opensource. Now this absolute beast of a model to come out of this lab, @PhishFort we’re seeing massive growth in our capabilities enabled by the new generation of decision models.
Today we release 𝚍𝟷-𝚞𝚕𝚝𝚛𝚊, our most powerful decision model. > built for hard decision problems. > d1-ultra is multimodal > supports 44 languages > #1 on the @ArtificialAnlys Decision Index (65) > leads all eight categories of our 112-evaluation suite 1/
1
3
14
1,456
Rich Counts retweeted
Today we release 𝚍𝟷-𝚞𝚕𝚝𝚛𝚊, our most powerful decision model. > built for hard decision problems. > d1-ultra is multimodal > supports 44 languages > #1 on the @ArtificialAnlys Decision Index (65) > leads all eight categories of our 112-evaluation suite 1/
65
186
87
1,618
303,402
Rich Counts retweeted
open d1 decision models are here! • small enough to run them on my macbook • multimodal for fun things like video input here i'm using d1-3B to rate how cute my outfit is. don't follow me for more fashion advice 💜 see more fun demos on our hugging face space: huggingface.co/spaces/Liquid…
Today we release Open d1: two open-weight multimodal models in our d1 decision model family. > d1-3B: text + vision > d1-omni-600M: text + image or text + audio > Real-time decision making anywhere, from data centers such as @nvidia DGX to RTX workstations to Jetson at the edge. 1/
11
22
2
207
11,662
Rich Counts retweeted
a lightweight drafter for vision language models 🌊✨
Today, we release an experimental DSpark draft model for LFM2.5-VL-3B, bringing speculative decoding to our vision-language models. A lightweight drafter proposes multiple tokens ahead, and the target model verifies them together in a single pass. This accelerates generation without changing output quality. Across six vision-language task categories at batch size 1 and temperature 0: > MLX on M5 Max: up to 3.13x faster decoding and 2.62x end to end > llama.cpp on M3 Ultra: up to 2.14x faster decoding and 1.77x end to end > SGLang on H100: up to 2.66x faster decoding and 2.27x end to end All evaluations were collected using Pipette, the benchmarking infrastructure behind Liquid AI's public device-performance data. 🧵
2
4
37
2,542
Rich Counts retweeted
1/ Excited to release The ultimate guide to multi-harness RL The same model behaves differently in every agent harness. So we built an open way to train any model with RL on any task set, inside the harnesses people actually use, like Claude Code, Codex, and OpenCode, without changing a single line of harness or training code. Trained across four harnesses, LFM2.5-2.6B went from 42% to 54% with 31% fewer tool calls. 🧵
53
89
17
798
107,746
Rich Counts retweeted
Replying to @liquidai
Proud to partner with @LiquidAI to help bring more personalized, context-aware AI experiences to Snapdragon powered devices.
12
1
75
8,695
Rich Counts retweeted
We're partnering with @Qualcomm to bring personal AI context to devices powered by Snapdragon. Liquid Context, our on-device context layer, is now optimized for Snapdragon processors and runs on the Qualcomm Hexagon NPU. Our goal: Give the agents people choose an understanding of what matters to them and when they need help. With the user's permission, Liquid Context learns from device signals and builds an understanding of their routines, preferences, and needs. That understanding is built and maintained locally, and Liquid Context shares relevant context with the user's chosen agents, whether they run on the device, in the cloud, or across both. That includes third-party agents and Liquid Agent, our efficient embedded agent powered by LFM2.5-2.6B. Running on the Hexagon NPU, Liquid Context works in the background and keeps that understanding current without requiring a cloud model to process every update. For device manufacturers, this is a path to add personal context to their devices while supporting their own choice of agents and services. OEMs building embedded or hybrid agents can also work with us to evaluate Liquid Agent. As our CEO @ramin_m_h said: "Personal AI starts with understanding how you live and what you need, when you need it. Liquid Context builds that understanding on your device so the agents you choose can offer more relevant help and anticipate your needs." > Read more about our partnership: liquid.ai/blog/liquid-contex… > Check out the livestream of @cristianoamon and Ramin's keynote here: youtube.com/watch?v=xKCto1Yf…
19
60
22
399
38,619
Rich Counts retweeted
Aging research spans many biological modalities, each traditionally requiring specialized models and pipelines. Instead, we train a single foundation model as a common reasoning layer across them – opening the door for researchers to interrogate clinical, genetic, epigenetic, transcriptomic, and proteomic data with the same model: > 🏥 Clinical: LFM2-2.6B ranked #1 on NHANES pairwise age prediction > 🧬 Genetics: LFM2-1.2B and 2.6B ranked #1 and #2 on masked OpenGenes. > 🧪 Methylation: LFM2-2.6B ranked #2 overall on GEO pairwise age. > 📊 Transcriptomics: LFM2-2.6B ranked #2 overall on GTEx age classification. > 🔬 Proteomics: both LFMs beat every frontier model evaluated on Olink pairwise age. We also ran feature ablations to test which biological measurements influence model predictions. Removing selected feature groups reduced confidence in correct answers and, in some cases, changed the final prediction. Our results demonstrate that LFMs drew on task-specific biological information rather than a single common shortcut.
2
2
1
29
2,867
Rich Counts retweeted
read this excellent view on the next phase of enterprise AI from our stellar COO, @jeffr3yli, in the Observer.
The next phase of A.I. will depend on agents that understand preferences, remember context and act proactively. That creates a new strategic question for companies: how much control are they willing to give A.I. platforms over the data powering those experiences? trib.al/SPRHffD
1
6
33
7,373
Rich Counts retweeted
Today we release LFM2.5-Encoder-230M and LFM2.5-Encoder-350M: bidirectional encoders that stay fast at long context, even on CPU. > LFM2.5-Encoder-230M: about 3.7x faster than ModernBERT-base on CPU at 8,192 tokens. Under 30s per forward pass, versus over a minute and a half. > LFM2.5-Encoder-350M: 4th of 14 models on GLUE, SuperGLUE, and multilingual classification, behind only three larger models, one of them nearly 10x its size. 🧵
36
111
41
919
200,038
Rich Counts retweeted
In strong support of open-weight AI and American AI leadership, we are proud contributors to the open-source community and excited to announce that Liquid Foundation Models (LFMs) have surpassed 40 million downloads by the community! Going forward, we remain committed to accelerating the open-weight release of the next generation of lightweight, powerful LFMs to the world. excited to see what you build with them! liquid.ai/models – at San Francisco, CA
🤖 Made with AI
20
67
7
692
57,468
Rich Counts retweeted
We doubled LFM2.5-8B-A1B's tokenizer from 65K to 128K to fix the languages it split too finely. Today we're sharing the recipe for upgrading a pretrained model's tokenizer in place. > Thai now takes 4.0× fewer tokens, Vietnamese 2.6×, Hindi 2.4× > Est. 2.2 to 3.7× faster per-character decoding on-device for these languages 🧵
22
71
19
571
63,952
Rich Counts retweeted
Introducing LFM2.5-230M: our smallest model yet, built to run fast anywhere (CPUs, NPUs, and GPUs) to enable agentic tasks on phones, robots, home and network automation devices. > 230M parameters, built on the LFM2 architecture > Pre-trained on 19T tokens, with a 32K context extension > Post-trained with distillation from LFM2.5-350M > 213 tok/s decode speed on Galaxy S25 Ultra (CPU) > 42 tok/s on a Raspberry Pi 5 (CPU) > Competes with and often beats models more than twice its size on instruction following, data extraction, and tool use. > use it for large-scale data extraction pipelines or lightweight on-device agentic workloads. 🧵
81
190
79
1,878
240,875
Rich Counts retweeted
Everybody is better than Jalen Brunson til it’s time to be better than Jalen Brunson… LFG @nyknicks!!!
102
2,378
135
16,755
827,795