The compute efficient layer for AI inference

Austin, TX
Joined October 2025
"These small models are going to get more and more important as compute gets tighter and tighter." Heard on All-In this week. That is the bet we built ZeroGPU on: small and open-weight models, run where the compute already is.
23
Our audio models now support batch tasks. Queue a backlog of recordings for whisper-tiny speech to text, or a list of scripts for chatterbox-nano text to speech, and collect the results when the job finishes. docs.zerogpu.ai/api-referenc…
22
New on ZeroGPU: gliner2.5-decide-v1, a small language model that picks from options you send with each request. Route agents to tools, triage support tickets, flag human handoff, no fine-tuning. docs.zerogpu.ai/api-referenc…
1
1
35
1)We served 11.8 billion tokens in 48 hours on 16,000+ idle laptops, desktops and phones. No data center needed to answer a single request. About 1,900x less energy than a typical data center AI prompt, and zero cooling water. Full benchmark: zerogpu.ai/benchmarks/edge-n…
35
One model finds personal details in six languages, so there is no translation step before redaction. Our small language model for PII detection covers 40+ entity types. Built for European outsourcers, cross-border fintech and privacy tools. docs.zerogpu.ai/docs/pii
21
Our open-weight models on Hugging Face have passed 40,000 downloads. Top of the list is our ZLM for IAB classification, which beat GPT-5.4 nano in about two of three blind tests and runs in the browser. Moderation and domain classification are there too. huggingface.co/zgpu-ai
1
50
Mask personal details before a model, a vendor or a log sees them. Our small language model for PII detection finds 40+ entity types in text. Built for contact centers, legal teams and healthcare AI. zerogpu.ai/use-cases/pii-red…
32
Two new small language models for extraction are live on ZeroGPU: gliner2.5-base-v1 for English, gliner2.5-multi-v1 for 50+ languages. Set your schema in the request and get JSON back, no fine-tuning. docs.zerogpu.ai/api-referenc…
1
1
26
Brand safety is two checks: IAB category and harm score. Our ZLMs for IAB classification and moderation run both, and our domain ZLM covers URL-only cases. Built for brand safety vendors, DSPs and agencies. docs.zerogpu.ai/docs/ad-tech
27
Qwen3.6-35B-A3B is live on ZeroGPU: one open-weight model for text, images and video. Send it a screenshot, a scanned doc or a clip and get structured output back. docs.zerogpu.ai/api-referenc…
1
45
Check every AI response before it reaches a user: our ZLM for moderation for text, Llama Guard 4 for images. Same API, one extra call. Built for agent platforms, copilots and LLM gateways. zerogpu.ai/use-cases/jailbre…
1
3
144
ZeroGPU now does audio. whisper-tiny for speech to text at two cents a minute, chatterbox-nano for text to speech with voice cloning at a penny. Both small and open-weight, both work with the OpenAI SDK. docs.zerogpu.ai/docs/audio
2
50