Zach R

Data/Analytics Engineer 📊 #SQL #data #analytics #BigQuery #GoogleAnalytics

[Zach R @zachr_data]

One of the first things I like to do with new hires is show them our global asset lineage in Dagster (the master DAG). It looks something like this

[Zach R @zachr_data]

Ok proud work moment, we are #1 on the App Store right now!

I modelled all the tracking/telemetry data, integrating it with existing web analytics pipelines so we have one stop shop datasets for all our web/app sessions and conversion funnels

[Zach R @zachr_data]

Me getting back into the gym

[Zach R @zachr_data]

Holy shit, this was > 5 years ago?

[Seth Rosen @sethrosen]

Them: Can you just quickly pull this data for me?

Me: Sure, let me just:

SELECT * FROM some_ideal_clean_and_pristine.table_that_you_think_exists

[Zach R @zachr_data]

DuckLake is cool. Next question, how do we scale the local querying?

Let my iPhone 15, laptop and desktop scale out a query on 1TB of data

[Zach R @zachr_data]

@MikeDoesData

[Zach R @zachr_data]

@matsonj Waiting for the day when I can test pipelines locally without paying for BigQuery slots on my 70tb Google Analytics 4 data

[Zach R @zachr_data]

Everyone else: LLMs are amazing, they are going to automate you out of a job

Me to LLM: Return BigQuery SQL that does a thing

LLM: Here is Redshift SQL

Me: ???

[Zach R @zachr_data]

Snowflake releasing semantic views, meaning you can semantic/metric layer directly in your cloud DW: https://t.co/SuzVMVMogY

I'm here for it, but I don't see docs yet on how you would consume from the semantic view. Maybe like

select conversion_rate() from semantic_view?

[Zach R @zachr_data]

good data > no data > bad data

[Zach R @zachr_data]

just wait til you get to your 30s

[10x'er @10x_er]

learning how similar you are to your dad in your mid to late 20's is the most terrifying thing they never tell you

[terminally onλine εngineer @tekbog]

everybody wanna train a ML model
but nobody wanna clean no big ass data

[Zach R @zachr_data]

@haro_ca_ first impressions matter!

[Zach R @zachr_data]

Tech debt is good actually *

Good if your middleware SQL logic enables business to know WTF was going on thru 3 site migrations and web analytics platforms

[Zach R @zachr_data]

@haro_ca_ I get it

[Zach R @zachr_data]

@tayloramurphy https://t.co/G4kcnhdKrn

[Zach R @zachr_data]

@theRealslimcam Tell me more plz

[Zach R @zachr_data]

Anyone here used Looker (as a semantic/metrics layer) and Tableau together? How is the native Looker to Tableau connector?

[Zach R @zachr_data]

BigQuery just released UNION ALL BY NAME

It solves the issue of perfectly aligning each field properly in SQL. As long as the fields have the same name you're good!

[Zach R @zachr_data]

@svpino https://t.co/DI7JshAeDO

[Zach R @zachr_data]

There's so much value to add anywhere along the data chain.

Honestly, blending business context (analyst focus) with data modeling is an extremely impactful role.

Yes there's some shit AE models out there, but I've seen some terrible SQL written by data engineers too

[Zach R @zachr_data]

Another analytics engineering (AE) LinkedIn bash post.

Hard to not react (my current job) but having an AE title does not assume you will build a spaghetti data architecture.

There are tons of data engineers who create perfectly optimized data models that are used by no one.