SeaweedFS

SeaweedFS is a scalable distributed file system optimized for exabyte small files, supports FUSE, S3 API, Hadoop, k8s, replication, Cloud Drive, S3 gateway.

[SeaweedFS @SeaweedFS]

@vv_nil looks nice! OK to copy the UI style into SeaweedFS?

[SeaweedFS @SeaweedFS]

🚀 SeaweedFS supports Amazon S3 Vectors API!

• AWS CLI & boto3
• Vector similarity + metadata filters
• Lance storage + LanceDB interoperability

S3 objects, tables, and vectors in one storage system!
https://t.co/c8sajozEaE

cc @lancedb @changhiskhan @eddyxu @xuanwo

[SeaweedFS @SeaweedFS]

cc #rclone @njcw

[SeaweedFS @SeaweedFS]

SeaweedFS 4.53: 3.15× faster S3 object listing!

Real-world benchmark with 1.7M+ objects spread across 6.5M+ directories, with deeply nested paths.

Before: 81 minutes
After: 26 minutes

Great to see the improvement confirmed by a user!

https://t.co/cjuVdzbnGo

[SeaweedFS @SeaweedFS]

@byte_array Use on-prem S3. SeaweedFS supports atomic conditional writes.

[SeaweedFS @SeaweedFS]

S3 over RDMA in SeaweedFS Enterprise is ~5× faster than HTTP for large-object GETs, reaching 11.4 GB/s on a single 100 GbE link.

S3 auth stays intact; data moves directly from storage servers to client memory via RDMA.

https://t.co/anH5QZhd3X

[SeaweedFS @SeaweedFS]

One table. Multiple query engines.

SeaweedFS Table Buckets expose standard Iceberg REST + S3, so the query engine is your choice.

Comparing:
* Trino for distributed SQL + writes
* DuckDB for embedded analytics

https://t.co/Fqu64kykiJ

#SeaweedFS #ApacheIceberg #DuckDB #Trino

[joel ⛈️ @joelhooks]

celld + alchemy + seaweedfs (s3)

using this heavy on local machines for alll sorts of crazy shit but particularly love pi-durable workflows it's unlocked https://t.co/gDXdKffJ0a

[Scott Watermasysk @scottw]

@thorstenball @ceccon_me @AmpCode For S3, I created a cheap VM with https://t.co/0iqH3F6jXg and use that for testing and development (orbs and local) in places where mocking/faking doesn't fit.

[SeaweedFS @SeaweedFS]

@NathanFlurry tested with SeaweedFS?

[pgEdge @pgEdgeInc]

In PostgreSQL, a 1,000,000-row table starts at 152 MB in the heap. After the pgEdge ColdFront archiver runs, 958,056 of those rows sit as Parquet files in object storage and the hot heap is down to 6624 kB. The table name and the SQL stay the same.

ColdFront is open source (PostgreSQL License) data tiering for PostgreSQL 16, 17, and 18. It moves older partitions to Apache Iceberg on S3 and keeps that data queryable and writable.

In the new walkthrough, an UPDATE on an archived row lands directly in object storage, with no rehydration and no restore job. A lake-native table stores 0 bytes in Postgres and takes plain INSERT, UPDATE, and DELETE. Concurrent writers across two Postgres nodes with 0 conflicts, 0 Lakekeeper 409s, and 12 Iceberg snapshots for 12 writes.

There's no narration and every step is explained on screen, so pause anywhere to read the SQL. The demos run on a local Docker stack with SeaweedFS standing in for a cloud bucket.

Watch the walkthrough: 🎬 https://t.co/WXU1I85jcP
ColdFront on GitHub: 🔗 https://t.co/AoYeuabTBb

#postgres #postgresql #apacheiceberg #opensource #dataengineering #database #datalake #parquet #s3 #docker #pgedge #coldfront

[Ignacio Van Droogenbroeck @hectorivand]

It's time, we are switching our copy everywhere, and updating our tests, and recommendation for on prem s3 to @SeaweedFS, @Minio is history.

We are starting today with the tests in the repo.

https://t.co/0gsRGTCV6F

[SeaweedFS @SeaweedFS]

Move from MinIO to SeaweedFS? It is just very simple and "works beautifully".

https://t.co/ejfnUkxcCd

[Mykhailo Chalyi @chaliy]

Head to head SeaweedFS vs RustFS

[Maximilien Comlan @_maxcomlan]

@appfactory It's, using celld and SeaweedFS for storage.
And it's a live multiplayer reaction game: a light flashes at the same instant for everyone on the page, timed by a Durable Object's own alarm. First click wins.

[SeaweedFS @SeaweedFS]

@almac_dev I can not help you replacing your drone, but just ask if any questions with the other replacement.

[SeaweedFS @SeaweedFS]

@touqeershafi stripe has minimum cost per transaction. Not really economical to start with too low.

[SeaweedFS @SeaweedFS]

SeaweedFS Table Buckets can tier each part independently, automatically based on data temperature.

⚡ Metadata → replicated SSD
📦 Parquet data → HDD
🧊 Cold data → erasure coding / cloud
⚡ Parquet footers → cached back on SSD

https://t.co/dAgtcwerEW

[SeaweedFS @SeaweedFS]

Why choose between Iceberg and Lance? You can analyze with Iceberg, and serve with Lance point lookups and vector search, with DuckDB joins them together.

SeaweedFS can host both table formats on the same object store, with built-in catalogs for each.
https://t.co/UzGbPeQZS7

[SeaweedFS @SeaweedFS]

@meHirenKavad Added https://t.co/PNLbWjAClG