Ok proud work moment, we are #1 on the App Store right now!
I modelled all the tracking/telemetry data, integrating it with existing web analytics pipelines so we have one stop shop datasets for all our web/app sessions and conversion funnels
Everyone else: LLMs are amazing, they are going to automate you out of a job
Me to LLM: Return BigQuery SQL that does a thing
LLM: Here is Redshift SQL
Me: ???
Snowflake releasing semantic views, meaning you can semantic/metric layer directly in your cloud DW: https://t.co/SuzVMVMogY
I'm here for it, but I don't see docs yet on how you would consume from the semantic view. Maybe like
select conversion_rate() from semantic_view?
Tech debt is good actually *
Good if your middleware SQL logic enables business to know WTF was going on thru 3 site migrations and web analytics platforms
BigQuery just released UNION ALL BY NAME
It solves the issue of perfectly aligning each field properly in SQL. As long as the fields have the same name you're good!
There's so much value to add anywhere along the data chain.
Honestly, blending business context (analyst focus) with data modeling is an extremely impactful role.
Yes there's some shit AE models out there, but I've seen some terrible SQL written by data engineers too
Another analytics engineering (AE) LinkedIn bash post.
Hard to not react (my current job) but having an AE title does not assume you will build a spaghetti data architecture.
There are tons of data engineers who create perfectly optimized data models that are used by no one.