@mim_djo@RonOrtloff @chimerasaurus @SnowflakeDB This demo used an “unmanaged” Iceberg table, so Athena = writer, and Snowflake = reader via Glue catalog integration.
“Managed” Iceberg tables enable read+write from Snowflake, Spark can read like so https://t.co/B6XUeQS9Vy
As the top chart shows, much less perf tradeoff
I just published "Snowflake tables on Cloudflare R2".
When replicating data to multiple regions, egress costs can be quite significant. So this is exciting: Now @SnowflakeDB can use @Cloudflare R2 as external storage for tables— featuring 0 egress fees❄️
https://t.co/rf7sW0St8r
1/Excellent presentation how #SnowflakeDB is implementing #ApacheIceberg, TL;DR, the data is saved as parquet in the user Cloud storage, but for efficiency reason, the metadata is generated on the fly when you connect your tool to the Snowflake Catalog
https://t.co/a6ZGg4aUZH
Interested in AI and data-led decisions? Check out our latest Success Story to learn how @hyperfinity + @SnowflakeDB are helping businesses use machine learning to make decisions related to areas like smarter supply chains, optimized pricing, and more: https://t.co/dcrYuIuCtZ
Neat story of a migration from Hive tables of JSON to Iceberg tables of Parquet at @Shopify
Thanks for sharing, Marc!
https://t.co/owXR245pIG
#ApacheIceberg
Today on the Trino blog, we recap the Trino Summit talk from Marc Laforet at @Shopify. He explains why and how Shopify used Trino to migrate from some old, custom, and poorly-optimized table formats to Iceberg, resulting in huge performance improvements.
https://t.co/BjBPb78oPH
@rajkrsen @neelesh_salian Similarly, my first thought was a table format like Apache Iceberg if you seek more control and interoperability of files in S3. Of course, that gained control and interoperability comes with the added responsibilities of security and maintenance.
@TableauTim@SnowflakeDB@awscloud I love it ❄️
There are far more expert people out there compared to me, like the Snowflake Data Superheroes https://t.co/KqIyWXk2DU
...but if you ever have q's or ideas, let me know! I recently completed the Data Lake Workshop, covers some similar topics https://t.co/dza3mTsfuF
Sharing some personal favs from day 1 of #SnowflakeBUILD (in no particular order)
First, a @felipehoffa sighting! Here's an interesting convo with a few engineering and product leaders across a few different parts of @SnowflakeDB
https://t.co/1rxAWCKXry
Last but not least, STREAMING
This session provides a nice overview and use cases for various ingestion methods with Snowflake. There’s also a demo of the Kafka Connector with Snowpipe Streaming
https://t.co/gbx7fjkS9G