Mark Lyons

product @cloudera | prev product @aws @dremio @verticaunified • #data #analytics #design #tech for 🌍

[Mark Lyons @mcl5tech]

@gjurvetson Have them. Very useful!

[Mark Lyons @mcl5tech]

@andrewlamb1111 Thanks for sharing!

[Mark Lyons @mcl5tech]

@nikunj Yup

[Mark Lyons @mcl5tech]

@cedar_db How is tpc-ds 1tb?

[Mark Lyons @mcl5tech]

@vanlightly Cool

[Aakash Gupta @aakashgupta]

True:

[Mark Lyons @mcl5tech]

@petereliaskraft +1 really cool!

[Marc Brooker @MarcJBrooker]

Microsecond-accurate time is now available in EC2 US East. So many cool things this makes possible: https://t.co/PE30frnkch

[Mark Lyons @mcl5tech]

@FintechKristen @BrightHorizons @reshmasaujani Yup. Crazy.

[Mark Lyons @mcl5tech]

@JoshuaSteinman I’ve been working on measuring credibility & expertise via Proof of Research (proof of work concept) any interest in discussing.

[Mark Lyons @mcl5tech]

Anyone looking for a new SA opportunity DM me and I can intro you to Roger Frey! (Great team & Roger is fantastic!!) https://t.co/XptCL8IVwC

[Mark Lyons @mcl5tech]

Verifying myself: I am markclyons on https://t.co/5qWN3EcfNC. 2RdVlnBARFNGHkBQEWYYppwhlr0zvyetUhBV / https://t.co/rGVgzAP62s

[Mark Lyons @mcl5tech]

@mim_djo @teej_m They deff are compressing and encoding the data and query execution as much as possible without materializing.

[Mark Lyons @mcl5tech]

@thetinot @mim_djo I believe for a fair compare you need to generate a net new tpch or ds data set to my comment the other day. There’s so much possibly fishy business w the data set already generated by snowflake

[Mark Lyons @mcl5tech]

@mim_djo Was it newly generated data set or a dataset they already created?

[Mim @mim_djo]

TPCH-SF30 ; 180 million rows
#AZURE D16DS_V5; 16 Cores, 64 GB RAM
#Databricks Photon 41 S
#DuckDB : 43 second
Query Parquet files from the VM SSD, no Azure storage involved
Databricks Software cost (not hardware) 4.4 $/Hour
https://t.co/6ceXlelXhO

[Mark Lyons @mcl5tech]

@KyleJWeller Nice! 👍

[Mark Lyons @mcl5tech]

@DavidAMaier @neondatabase Very cool - Checkout @projectnessie for Lakehouse branching!

[Dipankar Mazumdar @Dipankartnt]

Join @dremio’s Tech advocacy & Eng team for the very first installment of the @ApacheIceberg Office Hours 📆 🚀

We will kick-off with a brief presentation on Copy-on-Write Vs Merge-on-Read strategies, followed up by Q&A on anything Iceberg related.

When: December 7th, 12 PM

[Mark Lyons @mcl5tech]

@thetinot 👍