full-stack cloud for agents ⭐️ https://xitter.cf/t.co/MmrpwuU1G5

New York
Joined February 2023
POV: your agent has a desktop in the cloud 8 CPU, 16Gi RAM, $0.00025/second the future is here
16
9
3
262
62,857
ANNOUNCING: Open Jev Playground Try all the open-source alternatives to Jev as APIs > 50% cheaper than Jev 🤯 > $0.021 per 1M tokens > Hosted as OpenAI-compatible endpoints Explore the playground ↓
11
11
1
157
16,693
“Hey Codex, spin up a Redis” Introducing Beam DB. One-click Redis or Postgres. Agent-ready. Serverless. Give your agents persistence 💾
3
2
19
3,402
ANNOUNCING: Beam Compute Pools Cheapest GPUs + CPUs across 30+ clouds, with one-click autoscaling > Use your AWS, GCP or Azure credits > Run sandboxes, GPU inference, and task queues > H200s from $2.07/hr > CPUs from $0.04/hr > Run baseline traffic on-demand, autoscale to serverless for bursts We combined the simplicity of serverless with the flexibility of on-demand. I'm confident you'll save a ton of money on cloud costs if you start using this - give it a shot!
8
9
1
42
6,146
Introducing Capsule — The Infra Framework for AI Apps Capsule is a Python framework that provides infrastructure primitives for sandboxes, auth, session management, integrations, and payments. Capsule is @supabase for AI apps. You get a powerful Python SDK to iterate fast, and one command to deploy to the cloud. Using Capsule feels like using @beam_cloud or @modal. You don’t need to set up any infrastructure. There’s no Docker, just Python. The feedback loop is super fast. You deploy to the cloud with one command. At Beam, we have a bird’s-eye view into the AI apps people are building. Over the past year, we've watched people build the same 5-7 infra primitives over and over again. Capsule provides all of those primitives using a single SDK. @llom2600 originally built Capsule to prototype our own AI apps. We started selling some of these apps for real money and realized every app needs this, not just ours. Give it a try! Curious to hear what people think. Do AI apps have their Supabase yet?
31
20
12
134
44,920
Replying to @beam_cloud
@beam_cloud is so good! If you want to try using or deploying open-source models, give them a shot—the DX is fantastic.
1
1
6
1,273
Day 2 of building a YouTube thumbnail maker app. My friend and I found a newly released open-source image model, self-hosted it, and reduced costs 2x per thumbnail. Let's fcking go!
24
3
112
11,337
Beam (@beam_cloud) is an open source serverless platform for AI apps. Run GPU inference, background jobs, and sandboxes with ultrafast boot times and no vendor lock-in. ycombinator.com/launches/OuS…
10
14
82
11,965
Most RAG apps fail due to retrieval. Today, we'll build a RAG system that self-corrects inaccurate retrievals using: - @firecrawl for scraping - @milvusio as vectorDB - @beam_cloud for deployment - @Cometml Opik for observability - @Llama_Index for orchestration Let's go!
1
15
147
32,081
Really love what they are building at @beam_cloud. Cold boots are 80% faster!
Beam's cold boots are now 80% faster, thanks to GPU checkpoint restore. We save a snapshot of GPU memory after your model is loaded, so model weights don’t need to be reloaded on each cold boot. No other cloud provider can boot custom models onto GPUs this quickly.
1
2
921
Moved my #rpg #gamemaster #ai to use @beam_cloud , got a nice performance boost for the replies. Including cold starts, we end up below 1 minute in all cases so far. Just need to improve on the ui and finetune the model further. Looking for people to help with stories for the 2nd
1
1
3
645
We built an open source Lovable clone with Beam
6
1
14
2,080
AlphaCube is now running some of its beam searches on @beam_cloud GPUs (experimentally) Cold-starts in ~10 seconds, which I believe is the fastest (please tell me if you know of any faster alternatives)
1
1
8
939
We launched a cloud container running vscode with @beam_cloud's Pod abstraction Run vscode in a cloud container, exposed as an HTTPS endpoint You can hook this up to an LLM and ask for stuff like "launch vscode and run this python app inside it"
1
7
734
Our tech stack you ask?? 1. @golang Backend 2. React @remix_run + @vite_js + @shadcn frontend 3. @beam_cloud (Highly reccomended for serverless GPU hosting) 4. Workflow engine (secret sauce 🤫) 5. @vllm_project + @AIatMeta LLMs + VLMs + Structured Generation ... and more!
2
1
5
476
Started using @beam_cloud two weeks ago — absolute no-brainer for serverless GPU. Huge shoutout to the Beam team and @mernit for being super responsive and constantly pushing to make it even better.
1
4
396
Outlines user @mernit wrote a quick example on deploying Outlines (@dottxtai) to @beam_cloud! It is easy to do. Give it a look! (link in replies here)
1
2
14
919
Serverless slackbot in <50 lines of code @beam_cloud is a cheat code for building little apps like this
1
1
7
4,062
How we add GPU capacity at @beam_cloud 🧵 We run a globally distributed cloud, with a lot of GPUs. Capacity always changes, mostly because of increases in traffic. But we also swap hardware based on availability, region, and specific customer requirements. Here's how it works:
2
2
5
890
We’re happy to share that we are partnering with @beam_cloud. Now, you can deploy your AI models from Beam and easily use them in each AI workflow. Fast, simple, and scalable. 🚀 Let’s build smarter!
3
2
12
1,282