Product @Cloudflare working on Basin Pipelines, Catalog, SQL, and K2 🧊. Databases, streaming, distributed systems, tech, games, & 🎸
Elk Grove, CA
Joined January 2010
- Tweets2.1K
- Following638
- Followers960
- Likes932
Marc ⛅️ retweeted
Day 3 of Cloudflare connect! Come hear me talk about agents and data infra at 1:50 if you’re around.
There are some really interesting things you can do with this and our Basin analytics platform. I'm going to cook up a demo tonight - come find me at the Cloudflare booth tomorrow to check it out!
we shipped a new type of model: an extraction model!
pass it unstructured data, and get a list of the details and probability back. try it out and let us know what you think!
blog.cloudflare.com/clairic-…
I'm never getting the raid jackets I ordered am I?
After more than a decade of serving our players through the Bungie Store, we are retiring the current storefront for Bungie and Destiny related merchandise on October 19. We are building a new home for our merchandise that's more aligned with our current goals and vision. We'll share more information on where to find Bungie and Destiny merch in 2027.
- As a celebration and to show appreciation to our loyal fans, we're currently hosting a Bungie Store x Bungie Foundation Sale bungiestore.com/
- All Bungie and Destiny items will be discounted up to 77% off.
- Some retired rewards will be restocked.
- All orders will offer a flat rate shipping for $7.77 for all items in the sale. Standard ground shipping service within the continental US, EU, and UK only.
- 50% of all proceeds will benefit the Bungie Foundation.
- Sale ends on October 19, at 9:59am PT.
Marathon's current storefront will continue to operate in its current form, and its rewards and merchandise will remain available at marathon.bungiestore.com.
For more info visit: bungiestore.com/faq-us
Marc ⛅️ retweeted
Black box? Consider it observed 🤝
We’re building one observability platform to give you more visibility across Cloudflare services, the entire Workers platform, and even into your origin.
More coming 🤭 drop your wishlist below
Introducing Cloudflare Observability
We've been improving our Observability game in Cloudflare the last 2 years with Workers but now we're making OBS great platform wide!
blog.cloudflare.com/one-obse…
Tons of massive announcements today, I'll go through each of them one by one:
Durable, ordered event streams made so easy, GPT-3.5 could use it.
There is something so magical about running a simple command: `cf k2 streams create --name my_stream` and immediately produce and consume events.
We think this is going to be an extremely powerful data primitive since you'll now have an easy way to:
- Fan out events to N number of systems (operational DBs, other services, analytics, agents, etc)
- Replay events to bootstrap new/existing applications or services
- Do all this without configuring partitions, clusters, settings, etc (except for how long you want to keep the data for).
What do you want to see from K2 next? 🧡🧡🧡
Cloudflare K2 is a serverless event streaming service built directly on top of R2 object storage for high-scale data movement and long-term retention. By decoupling producers and consumers at the edge, K2 enables durable, ordered log streams without the operational overhead of traditional broker clusters. cfl.re/4xRcTiL #BirthdayWeek
Marc ⛅️ retweeted
The Cloudflare Data Platform has been in beta for the past year and has helped amazing companies like @anomalyco ingest, store, and query their analytical data. Today, for @Cloudflare Birthday Week, we're going GA. And we have a new name: Cloudflare Basin.
You can now use our hit catch phrases such as "we're data Basin now" or "slappin da Basin" in production.
Super excited and proud of what the team has done this year. Give yourself and your agents a platform to ingest, store, and query data in Apache Iceberg in seconds.
Anyone who's worked in data infrastructure knows the absolute joy (😬😬😬) of:
1. The back and forth of setting up permission and trust policies
2. Configuring storage profiles
3. Network rules and configuration
4. Provisioning compute
5. Actually configuring the tool(s) you're trying to use
6. Repeat steps 1-5 for every tool
6. Then you can finally start ingesting data
This is absolutely ridiculous and we're here to Cloudflare-ify data analytics:
- Go from nothing to querying data in seconds
- Keep data open and portable (actually open and portable, anything can read/write)
- Essentially free to experiment and have fun with, pure usage based economics at scale
You amazing people have been keeping us busy this year putting your data apps in production (despite the beta badge hehe) - We already have an extremely packed Q4 ahead of us but tell us what you want to see from us next 🧡🧡🧡
During Birthday Week 2025, we announced the Cloudflare Data Platform, a suite of products that ingest, store, and query your analytical data. Today, we’re announcing that the platform is generally available, and we’re giving it a new name: Cloudflare Basin. cfl.re/4yv3mz6 #BirthdayWeek
Marc ⛅️ retweeted
For Arroyo 0.16 (coming very soon!) we rebuilt the control plane, in order to scale to the thousands of jobs we're running for Cloudflare Pipelines. Along the way we had to design a new distributed fencing protocol on r2/s3 to achieve exactly once commits: arroyo.dev/blog/worker-leade…
What data and analytics related things do you want to see? 👀
Lots of what we ship for @Cloudflare Birthday Week starts with someone asking for it here. Less than a month out. Ask.
It's getting harder and harder to tell where @opencode begins and where @OpenCodeJr ends.
All I want is an @OpenCodeJr harness to bring a little whimsy to my day
It's fascinating that the harness is becoming more important than the foundational models themselves. 2 months ago I was deep in Opus 4.8. Now I'm primarily using GPT 5.6 Sol. The harness ( @opencode in my case) is the only constant.
To me it's the equivalent of getting to pick your perfect phone (hardware) but being able to swap between iOS or Android with a tap depending on who offers the better experience for me.
Lots of folks are doing DataFusion things which is awesome. Few are doing it in a massively distributed way on the edge. This is going to be a 🔥 talk for data and distributed systems nerds alike.
Apache DataFusion Community Showcase Vol. 4 📣
Thursday, August 20th at 9:00 am PST on Zoom - featuring @jeromeschneider of Cloudflare R2 SQL and Tobias Schwarzinger of RDF Fusion.
1) "Building R2 SQL on DataFusion"
R2 SQL is Cloudflare's serverless, distributed, analytics query engine for Iceberg catalogs. This talk presents how R2 SQL integrates @ApacheDataFusio and Datafusion Distributed over Cloudflare infrastructure, and some of the challenges faced to make it work.
2) "Graphs, Piecewise Functions, and Apache DataFusion"
Tobias' reserach group at @tu_wien investigates the use of graph data in IoT use cases. Often, you find that you must combine knowledge about the system (which is stored in graphs) with the run-time data from sensors in a single query. To enable both types of data to exist within a single query engine, RDF Fusion implements SPARQL, while PolyArrow implement querying over "piecewise signals" (i.e., instead of treating a time series as points the interpolation strategy is part of the data model). Both are prototypes based on DataFusion. This talk will cover the fundamentals, then how we build on DataFusion, some workarounds that we need to employ, and give an outlook on how we could combine these two efforts.
cc @CloudflareDev, @andrewlamb1111, @InfluxDB
Join us! Sign-up here: hubs.ly/Q04sGrN_0
Marc ⛅️ retweeted
Do you build Cloudflare Workers with Vite? Do you use Auxiliary Workers?
This is a part of the config we are considering changing and we would like to hear from any users of it. Discussion here: github.com/cloudflare/worker…
Marc ⛅️ retweeted
we built a web browser that runs in Workers, within v8 isolates
it uses ~4x less memory
which means horizontal scale — give millions of concurrent agents their own browser
the moonshots are landing. still can’t believe this worked
blog.cloudflare.com/kitesurf…
The @CloudflareDev Data Platform team is hard at work getting ready for our GA but we've got a few (highly requested) feature drops incoming, starting with...
You can now query your tables in R2 Data Catalog directly from the Dash with R2 SQL
developers.cloudflare.com/ch…
