@MangoBoost_Inc

MangoBoost is a DPU and AI infrastructure provider specialized in developing full-stack, advanced server accelerator solutions.

 Bellevue, WA
mangoboost.io/
Joined September 2024
  • Tweets40
  • Following7
  • Followers33
23Media
Proud to have teamed up with @AMD on @MLPerf Inference v5.1, with record results on Instinct™ GPUs and the first heterogeneous submission! 👉 Explore AMD’s technical deep dive: rocm.blogs.amd.com/artificia… #AI #LLM #Inference #AMD #Instinct #GPU #Server

Technical Dive into AMD's MLPerf Inference v5.1 Submission

In this blog, we share the technical details of how we accomplish the results in our MLPerf Inference v5.1 submission.

rocm.blogs.amd.com
1
154
MangoBoost retweeted
MLCommons@MLCommons9 Sep 2025
Thank you to our submitters @AMD, Amitash Nanda, @ASUS_OFFICIAL, @Broadcom, @Cisco, @CoreWeave, @DellTech, @gateoverflow, @GigaComputing, @Google, @HPE, @intel , KRAI, @LambdaAPI, @Lenovo, @MangoBoost_Inc, @Azure, @MiTACcomputing, 3/4
1
2
1
304
🚀 Try the AI acceleration solution proven in @MLPerf Inference v5.1, free of charge. ☑️ Run LLM on MI300X & MI325X servers ☑️ Experience LLMBoost™ and GPUBoost™ RDMA ☑️ See how MangoBoost accelerates AI inference 📷 Register: mangoboost.io/ai-virtual-dem… #AI #LLM #GPU #AMD
78
🚀 MangoBoost, @AMD, @Dell and @Supermicro_SMCI set new @MLPerf records! ✅ 648K tok/s on Llama2-70B (open) ✅ 1st heterogeneous GPU scaling (MI300X + MI325X) ✅ 1st 3rd-party multi-node MI355X showcase 📎 Read more: mangoboost.io/resources/blog… #AI #LLM #AMD #GPU #Dell #SMCI
1
136
🚀MangoBoost's optimization software LLMBoost and @Supermicro_SMCI deliver 1.96× faster AI inference and 40% faster training with @AMD MI300X and MI325X clusters. 📙Read the whitepaper here: supermicro.com/en/accelerato… #GPU #Server #LLM #AI #GenAI #LLaMa #ML #Software #SW
1
130
🚀MangoBoost sets a new @MLPerf Storage v2.0 record with DPU-accelerated @NVMexpress NVMe NVMe/TCP! Up to 7.5x GPU scaling and local SSD performance over 400G Ethernet🔥 📎Read more: mangoboost.io/resources/blog… #AI #LLM #Storage #NVMe #TCP #GPU #SSD #Ethernet

MangoBoost Demonstrates Record-Breaking Performance in AI Training Storage Solution with MLPerf®...

MangoBoost Demonstrates Record-Breaking Performance in AI Training Storage Solution with MLPerf® Storage v2.0

mangoboost.io
80
🚀Mango StorageBoost™ - NTI is now @NVMexpress certified by the UNH Interoperability Labs. SSD performance and simplicity, powered by NVMe-oF. Enterprise-ready. #AI #Storage #NVMe #TCP #Initiator #DataCenter #Enterprise #Infra
74
🚀MangoBoost + @AMD Alveo™ U45N = 3× faster NVMe/TCP Initiator Our StorageBoost™ NTI + U45N offload delivers 5.37M IOPS vs. 1.93M on NVIDIA CX6 (4KB reads) and ~60% better writes, with minimal CPU use. Learn more: docs.amd.com/r/en-US/wp564-u… #NVMe #TCP #Storage #AI #DataCenter
81
🔥MangoBoost LLMBoost™ cut Llama2-70B training time by half in @Dell 's test with AMD MI300X. Multinode AI training, made easy. 🔗 infohub.delltechnologies.com… #Dell #AMD #GPU #LLM #AI #GenAI #MLPerf #Training

Dell PowerEdge XE9680 Server and AMD Instinct™ MI300X GPUs Deliver Superior MLPerf™ Training v5.0...

OverviewDell Technologies recently submitted results to the MLPerf Training v5.0 benchmarking suite. The MLPerf Training submission is a comprehensive benchmarking suite designed to evaluate the...

infohub.delltechnologies.com
3
10
1,106
MangoBoost retweeted
MLCommons@MLCommons4 Jun 2025
2/ Thank you to all 20 submitters: @AMD , @ASUS, @Cisco , @CoreWeave , @Dell , @GigaComputing , @Google Cloud, @HPE , @IBM , Krai, @LambdaAPI , @Lenovo , @MangoBoost_Inc , @nebiusai , @nvidia , @Oracle , @QuantaQCT , @scitix , @Supermicro_SMCI , @tinycorp .
3
2
5
668
MangoBoost has signed an MoU with AIC to co-explore DPU-powered server & storage innovation. Together, we aim to deliver scalable, AI-ready infrastructure for the enterprise market. Efficiency meets performance. Read more: shorturl.at/ms7gu #DPU #Storage #Server
2
141
MangoBoost retweeted
MLCommons@MLCommons2 Apr 2025
5/ KRAI, @LambdaAPI, @Lenovo, @MangoBoost_Inc, @nvidia, @Oracle, @QuantaQCT, @Supermicro_SMCI, @SMC_FutureAI, & @vmwarevcf A special congratulations to CoreWeave, FlexAI, GATEOverflow, Lambda, and Mangoboost - who are all first time submitters to MLPerf Inference!
1
3
325
🚀 MangoBoost & @AMD set a new @MLCommons MLPerf Inference v5.0 record! 🔥 103,182 TPS (Offline) & 93,039 TPS (Server) on MI300X GPUs – 24% faster than NVIDIA H100 Read more: shorturl.at/s0rcD #MLPerf #AI #LLM #Inference #AMD #MI300X #GPU #ROCm
1
2
206
🚀 Mango LLMBoost™ is now on Google Cloud Marketplace! Optimize AI inference with our containerized solution—faster performance, lower costs, and seamless GPU efficiency. Try it free today! → console.cloud.google.com/mar… #Google #GoogleCloud #GCP #Cloud #AI #LLM #Inference #GPU
2
126
🚀 Mango LLMBoost™ is now on Microsoft Azure! Optimize GPU efficiency for AI inference with our containerized, deployment-ready solution. ✅ 12.6x AI inference performance ✅ 92% cost savings Try it FREE today: azuremarketplace.microsoft.c… #Microsoft #Azure #AI #Inference
2
104
🚀 Chanik Park, ex-Samsung Semiconductor exec, joins Mangoboost as Chief Commercial Officer. With his global scaling expertise, he's ready to supercharge our growth and redefine data center efficiency. Welcome aboard, Chanik! #DPU #DataProcessingUnit #DataCenter
1
130
🎊Mango StorageBoost™ is now NVM Express™ compliant! ✅Seamless integration ✅Faster performance ✅Future-ready for AI & big data Unlock your storage potential today: nvmexpress.org/compliance/ @NVMexpress #NVMe #NVMExpress #Storage #DataCenter
2
51
🚀 Introducing Mango LLMBoost™: 12.6x faster and 92% cheaper AI inference! - Flexible GPU support (NVIDIA & AMD) - Multi-model management - Easy deployment with web APIs - OpenAI-compatible Try for FREE on AWS (link in comment)! #LLM #AI #Inference
2
1
69
More information on Mango LLMBoost™: mangoboost.io/products/softw…
1
62
Try Mango LLMBoost™ on AWS for FREE: aws.amazon.com/marketplace/p…
1
44
Load more