XetHub enables ML teams to collaborate effectively on massive datasets. Now part of @HuggingFace 🤗!

Joined March 2022
We're turning @huggingface Hub's files into content-defined chunks to speed up your workflows!⚡️ This means: - 🧠We store your file as deduplicated chunks - ⏩ You only upload changed chunks when iterating! - 🚀 Pulling changes? Only download changed chunks!
4
17
1
54
17,338
Sweet visualization of S3 PUT requests to @HuggingFace Hub over a 24-hour period, showing upload density across the globe. 🌏
1
10
35
5,736
Did you know that @Huggingface Hub holds over 29 PB of Git LFS files across datasets, models, and spaces? 📈 That's the equivalent of 64 @CommonCrawl downloads - and it's growing every day. So what's inside? 🧵
1
1
7
499
XetHub retweeted
Welcome, Gradio 5 👋 We’ve been hard at work over the past few months, and we are excited to announce today the stable release of Gradio 5! With more than 2 million users every month (and >470,000 apps on Hugging Face Spaces), Gradio has become the default way to build, share, and use machine learning applications. Our goal with Gradio 5 was to address the most common pain points that we’ve heard from Gradio developers about taking these apps to production. Here are 5 new things in Gradio 5 (including a new way to build Gradio apps without writing any code!)
23
108
29
551
211,665
Deduplicating evolving datasets is a no-brainer - store differences instead of full versions of each one. But format matters! Here's how appends, modifications, and deletes on @ApacheParquet files (~20% of what's stored on @huggingface Hub) deduplicate. 🧵
2
12
3
31
12,935
It's the end of an era. We just shut down our @xetdata servers after 658 days in production. 🪦 What did we learn? xethub.com/blog/shutting-dow…
2
6
14
3,584
First demo of a @xetdata-backed roundtrip to/from @huggingface servers = first steps to a faster, more scalable HF Hub! ⚡️🤗
1
3
1
17
9,282
I’m in Austin for #DataCouncil23! Reach out if you’ll be there and have MLOps challenges to share — I’d gladly buy you a beer (or brisket) to learn more!
1
1
165
When we launched our public beta in December, the first request we got from our users was an ask for Windows support. Today, we’re excited to announce that XetHub @xetdata now supports Windows environments in addition to MacOS and Linux! Read more here: hubs.li/Q01FGwyT0
1
3
161
Last week, I talked to @BuiltInSeattle about how XetHub makes working with data as fast and as easy as how you work with code. Read all about it here: builtinseattle.com/2023/02/1… PS: We’re hiring! Check out @XetData's openings here: xetdata.com/careers/
1
4
145
Excited that @xetdata was named Startup of the Day by @mollywood and @Jason on @TWiStartups! We appreciate the shoutout, and we’ll keep working to make ML data collaboration easy. youtube.com/watch?v=1chJm9rU…
1
3
144
Excited to share that XetHub is publicly available now, try it out: xethub.com. So. much. fun. Launching XetHub with our team has been incredible.
1
4
201
We are excited to announce our investment in @xetdata, which makes it easy for businesses to use Git for data management. We worked with 2 of the 3 co-founders at Turi (acquired by Apple) and couldn't be more excited to work with them again! Read more: bit.ly/3IwnNVe
1
1
4
400
XetHub raises $7.5M for its Git-based data collaboration platform techcrunch.com/2023/01/09/xe…
1
1
1
1,858