lead product for inference @togethercompute. invest in ai/ml, infra, dev tools. ex @temporalio, @google
San Francisco, CA
Joined July 2011
- Tweets486
- Following328
- Followers2.1K
- Likes3.9K
Pinned Tweet
i'm hiring! job-boards.greenhouse.io/tog…
i would love to talk to folks who geek out on APIs, agent experiences, harnesses, and open-weight models
when i first joined together i could not keep the open-weight model names straight (looking at you DeepSeek-V4.1-Flash-1017)
now i can tell apart 17 different Qwen variants but can’t remember what i ate for lunch
Nikitha Suryadevara retweeted
minimax m3.1 flash is now live on together ai
we’re excited to be a day-0 launch partner for the model, aka space bunny
m3.1 flash is built for agentic tasks, coding, computer use + cybersecurity, with a 1m context window and vision support
try it now together.ai/models/minimax-m…
huge for personal agents!
a while back we worked with 1password on a preview of this that integrated into @trydirector
so excited to see this generally available as a much needed extension for the personal assistant space
Nikitha Suryadevara retweeted
Muse Spark Open is now live on Together AI.
We're proud to be a Day 0 launch partner for @AIatMeta's Muse Spark Open, the most capable US open-weights model to date, built for long-running agentic coding workflows that keep entire codebases in context.
Nikitha Suryadevara retweeted
2 yrs ago i had voice agents all around to all the coffee shops in sf and ask if they have ac
it’s live again, updating it with corgi data now
peytoncasper.com/ac-map/
Saturday will be one of the hottest days of the year for the entire Bay Area. Downtown San Francisco is forecast to reach 94°F in the afternoon, while Ocean Beach, just over 6 miles to the west, is expected to be in the low 60s.
The Outer Sunset and Outer Richmond could briefly climb into the 80s around noon before the sea breeze kicks in during the afternoon.
Welcome to Indian Summer.
Nikitha Suryadevara retweeted
Today we're excited to announce @HalluminateAI's $30M Series A led by @oakhcft with participation from @YCombinator, @orangecollectv, @FTPartners, @heavybit, and more.
Nikitha Suryadevara retweeted
shhh
today we’re launching function secrets
our customer’s agents are performing millions of logins every day and they should have a secure way to handle them
i didn’t realize how much working on k8s/borg would prepare me for running these beasts
Our serverless APIs for open weights models have become exquisite machinery (that we plan to write more about soon!)
One effect is that @togethercompute now one of the largest originators of open tokens in the US, with a wild week over week growth curve that reflects the pace of OSS adoption. Will serve 1.8T tokens today on @OpenRouter alone.
You can get started with $5 — api.together.ai
openrouter.ai/provider/toget…
pro tip: flour + water does half portions of most things on their menu if you go solo. perfect portion sizes!
Nikitha Suryadevara retweeted
Our dedicated model inference @togethercompute now supports canary rollouts with gated steps for safe, cost efficient and zero downtime upgrades on live traffic.
A post on how to use this feature.
New on Dedicated Model Inference: canary rollouts.
Upgrade the model behind a live endpoint without downtime. Traffic moves from your current deployment to the new checkpoint in gated steps (default 5% → 25% → 50% → 100%).
Health checks run before any traffic shifts. After every step, metric gates compare the new model's p95 latency and error rate against the old one. If a gate trips, the rollout pauses at the canary share and waits for you: resume, promote to 100%, or roll back.
Three strategies: canary, blue-green, and rolling. Available now via the tg CLI, REST API, and Python SDK.
Learn how to start a rollout: together.ai/blog/canary-roll…
i did not realize growing up to be a real adult would mean getting an inordinate amount of joy from replacing my regular toilet with a toto
Nikitha Suryadevara retweeted
omg @togethercompute I love you. this is time to first token for every provider for Deepseek v4.1 flash. you guys CRUSH on pre-warmed queries. there's no other game in town
Nikitha Suryadevara retweeted
We did it again. Temporal just raised a $550M Series E round at a $12.55B valuation.
Learn more about how we got here: temporal.io/blog/temporal-ra…
Nikitha Suryadevara retweeted
Nice stats from @OpenRouter that illustrate how @togethercompute delivers solid and scaled performance for agentic workloads.
We are serving GLM 5.3 and GLM 5.3 Flash @ top decile of TPS, latency, cache rate, and doing it at large volumes, 23% and 30% of all OpenRouter traffic, and OpenRouter is a fraction of our overall API traffic.
Running scaled inference for agentic applications is a lot more than maxxing a single metric ... you need to optimize on all dimensions and doing so at scale with reliability.
openrouter.ai/z-ai/glm-5.3
openrouter.ai/z-ai/glm-5.3-f…
Nikitha Suryadevara retweeted
i put cad in a terminal, won @OpenAI gpt6 hackathon and $50k
cad sandbox puts fusion 360 on a vm, wrapped its sdk with a server, live streamed model state to a browser running in a terminal and let astra go nuts
$5k in tokens to the craziest idea in my dms and a shot for every mech e that’s been personally attacked by this idea
3/ CAD Sandboxes 🥇$50,000 credits + DevDay tickets
SDK and visual design inspector for Astra to interface with Fusion 360 via Codex
Browserbase, but for CAD
@peytoncasper