XetHub

XetHub enables ML teams to collaborate effectively on massive datasets.

Now part of @HuggingFace 🤗!

[XetHub @xetdata]

Big news: We’ve closed a $7.5 seed round led by @MadronaVentures! We talked to @fredericl of @TechCrunch about our fundraise and how XetHub gives developers a faster and easier way to work with data via a Git-enabled way: https://t.co/0zyRVqYvxE

[Ann Huang @AnnInTweetD]

We're turning @huggingface Hub's files into content-defined chunks to speed up your workflows!⚡️

This means:
- 🧠We store your file as deduplicated chunks
- ⏩ You only upload changed chunks when iterating!
- 🚀 Pulling changes? Only download changed chunks!

[Ann Huang @AnnInTweetD]

Sweet visualization of S3 PUT requests to @HuggingFace Hub over a 24-hour period, showing upload density across the globe. 🌏

[Ann Huang @AnnInTweetD]

Did you know that @Huggingface Hub holds over 29 PB of Git LFS files across datasets, models, and spaces? 📈

That's the equivalent of 64 @CommonCrawl downloads - and it's growing every day. So what's inside? 🧵

[Gradio @Gradio]

Welcome, Gradio 5 👋

We’ve been hard at work over the past few months, and we are excited to announce today the stable release of Gradio 5!

With more than 2 million users every month (and >470,000 apps on Hugging Face Spaces), Gradio has become the default way to build, share, and use machine learning applications.

Our goal with Gradio 5 was to address the most common pain points that we’ve heard from Gradio developers about taking these apps to production. Here are 5 new things in Gradio 5 (including a new way to build Gradio apps without writing any code!)

[Ann Huang @AnnInTweetD]

Deduplicating evolving datasets is a no-brainer - store differences instead of full versions of each one. But format matters!

Here's how appends, modifications, and deletes on @ApacheParquet files (~20% of what's stored on @huggingface Hub) deduplicate. 🧵

[Ann Huang @AnnInTweetD]

It's the end of an era. We just shut down our @xetdata servers after 658 days in production. 🪦 What did we learn?

https://t.co/ufXQnZOvPD

[Ann Huang @AnnInTweetD]

First demo of a @xetdata-backed roundtrip to/from @huggingface servers = first steps to a faster, more scalable HF Hub! ⚡️🤗

[XetHub @xetdata]

@huggingface 🤔 What features do you want us to bring to Hugging Face Hub? We'd love to hear your ideas!

[XetHub @xetdata]

Almost three weeks into our @huggingface experience and loving it! Digging into a POC of replacing Git LFS and exploring developer experiences = our happy place 🤗

[XetHub @xetdata]

@huggingface Read more: https://t.co/WHmQfRrPDZ

[XetHub @xetdata]

Try it for yourself! https://t.co/DuWYN9zjCP

[XetHub @xetdata]

🧞‍♂️ Ever wished you could share an interactive view of your work with a collaborator, instead of static screenshots and long descriptions? 🤓 Wouldn't it be nice to quickly review differences on binary files in the browser like you do with code?

[XetHub @xetdata]

✨ Now you can, with XetHub custom views. Custom views lets you create interactive views that live alongside the files in your repository, bringing instant context to opaque binary files whether you're browsing or comparing files.

[XetHub @xetdata]

@TMLS_TO @LightningAI Sunday: Fun community picnic 🧺 with the whole Toronto scene

[XetHub @xetdata]

So excited to be in Toronto for a wonderful @TMLS_TO weekend! Come join us!

[XetHub @xetdata]

@TMLS_TO Saturday: Sweet LLM hackathon with ⚡@LightningAI

[XetHub @xetdata]

👉 Read the full article: https://t.co/1VlPLXclfe

[XetHub @xetdata]

🤔 How does your versioning tool stack up to the competition? We benchmarked the iterative development experience of three real-world modern workflows (🎮 game development, 🧬 biotech, and 🧑‍🔬 research) on S3, DVC, Git LFS, and XetHub. The results?

[XetHub @xetdata]

- 50% savings in average upload times vs nearest competitor
- Better average download times vs competitors
- 50% savings in final storage used vs nearest competitor