The Token Company (YC W26) (@thetokenco) header
The Token Company (YC W26) (@thetokenco) profile picture

Building custom ML models for compressing raw LLM inputs

San Francisco, US
Joined January 2026
Photo by The Token Company (YC W26) (@thetokenco)Photo by The Token Company (YC W26) (@thetokenco)Photo by The Token Company (YC W26) (@thetokenco)Photo by The Token Company (YC W26) (@thetokenco)Photo by The Token Company (YC W26) (@thetokenco)Photo by The Token Company (YC W26) (@thetokenco)Photo by The Token Company (YC W26) (@thetokenco)
We’re introducing bear-2-safety for private preview, a compression model to optimize cost and performance for LLM safety moderation pipelines, such as Llama Guard and ShieldGemma. Bear-2-safety selectively deletes tokens before safety inference, lowering costs while maintaining classification accuracy.
7
5
17
2,269
bear-2-safety is a fully extractive compressor, it retains surviving tokens in their original order without any paraphrasing. To implement bear-2-safety, just run one compression model call in front of Llama-Guard, ShieldGemma, or any other safety classifier.
2
1
288
We have two variants available: bear-2-safety-prompt, for user prompt moderation, and bear-2-safety, for user prompt and agent response moderation. If you’re interested, we're rolling out access to select partners upon request. Read our blog post here: thetokencompany.com/blog/bea…
2
218
👀👀
🦔Microsoft canceled its internal Claude Code licenses this week after token-based billing made the cost untenable, even for a company with effectively infinite cloud resources. Uber's CTO sent an internal memo warning the company burned through its entire 2026 AI budget in just four months. American AI software prices have jumped 20% to 37%, and GitHub (owned by Microsoft) is dropping flat-rate plans for usage-based billing across its products. My Take The AI subsidy era is ending in real time. The same company that put $13 billion into OpenAI and built the Azure infrastructure powering most of Anthropic's compute just looked at the bill from a competitor's coding tool and decided it was not worth paying. That is not a productivity failure on Anthropic's end. Token-based pricing is forcing every enterprise customer to confront the actual cost of running these models at scale, and the number turns out to be far higher than the flat-rate experiments suggested. This ties directly to my Gemini Flash post yesterday. Anthropic, OpenAI, and Google all raised effective prices in the last six months. Enterprises that built workflows assuming AI costs would keep falling are now watching annual budgets evaporate in months. Two outcomes look likely from here. Either enterprises scale back AI usage to fit budgets, which slows the revenue ramp the labs need to justify their valuations ahead of IPOs, or the labs cut prices and absorb the losses, which makes the unit economics worse at exactly the wrong moment. Both paths land in the same place, the numbers stop working, and somebody has to take the writedown. Hedgie🤗
1
1
4
980
Save on your LLM bill with @opencode and @thetokenco
pushed an update to the @opencode plugin using the @thetokenco compression model for reducing input tokens for every prompt. i've been meaning to ship an update every since plugins got updated! > added compression status to sidebar widget > added opencode command for easier adjustments i set it, forget it, and use it every single day
1
3
680
The Token Company (YC W26) retweeted
The Token Company is now HIPAA compliant! Customers using The Token Company's models to compress LLM inputs can now securely process protected health information. Our compression models reduce bloated context from LLM inputs making LLM models perform better and cheaper under long inputs
1
3
5
741
The Token Company is now HIPAA compliant! Customers using The Token Company's models to compress LLM inputs can now securely process protected health information. Our compression models reduce bloated context from LLM inputs making LLM models perform better and cheaper under long inputs
1
3
5
741
The Token Company (YC W26) retweeted
Claude Code making really pretty animations
1
5
246
Evaluating compressed prompts just got easier. You can now compare LLM outputs before and after compression in our Compression sandbox to directly evaluate your use case.
1
5
618
The Token Company (YC W26) retweeted
i built a plugin that saves you hundreds of dollars in @opencode by using the @thetokenco compression model, it shrinks the amount of tokens in your input query before hitting the models the queries are faster and cheaper, all while maintaining output quality
The Token Company (@thetokenco) builds LLM input optimization to lower costs, reduce latency, and improve accuracy. Congrats on the launch, @OtsoVeistera! ycombinator.com/launches/Pb3…
1
1
7
967
Compression absolutely crushed SEC filings Does anyone actually read these? I don't know, but we let our bear-1.2 LLM compression model do that on FinanceBench (150 real SEC filing questions) Bro got up to 84.7% accuracy (vs 82% baseline) with 20% token reduction. Saves costs, boosts speed, crushes financial analysis Removing bloat makes the model perform better
2
1
5
519
The Token Company (YC W26) retweeted
The Token Company (@thetokenco) builds LLM input optimization to lower costs, reduce latency, and improve accuracy. Congrats on the launch, @OtsoVeistera! ycombinator.com/launches/Pb3…
12
18
2
226
27,720
The Token Company (YC W26) retweeted
One of my batchmates is starting his fundraise earlier because he needs to take his highschool exams right before demo day I've never been aura farmed on so much in my life
2
1
56
3,957
The Token Company (YC W26) retweeted
Incredibly excited about this! 🔥🔥🔥
You're wasting half your context window. We’re launching @thetokenco (YC W26) today. We compress LLM inputs before they reach the model. Fewer tokens, lower cost, faster inference. Models also perform better. In customer case studies we’ve seen a +5% lift in user purchases due to higher preference for outputs from compressed prompts. The API is live. Link in the comments
68
2
1
52
14,382
The Token Company (YC W26) retweeted
seems like all our residents are launching today congratulations @OtsoVeistera & @rasmus_up 🎉
You're wasting half your context window. We’re launching @thetokenco (YC W26) today. We compress LLM inputs before they reach the model. Fewer tokens, lower cost, faster inference. Models also perform better. In customer case studies we’ve seen a +5% lift in user purchases due to higher preference for outputs from compressed prompts. The API is live. Link in the comments
4
32
4,569
The Token Company (YC W26) retweeted
You're wasting half your context window. We’re launching @thetokenco (YC W26) today. We compress LLM inputs before they reach the model. Fewer tokens, lower cost, faster inference. Models also perform better. In customer case studies we’ve seen a +5% lift in user purchases due to higher preference for outputs from compressed prompts. The API is live. Link in the comments
75
54
23
512
100,134