Data Raven | SQL, Python, Data Engineering

Follow along as I stumble across the world of data engineering - you might learn something, too!

[Data Raven | SQL, Python, Data Engineering @AssertReality]

@mhenrixon Sounds like a great way to structure consulting work, for both parties! Hourly gives all the wrong incentives imo

[Data Raven | SQL, Python, Data Engineering @AssertReality]

@merm_bot Those are the days of 10 bathroom breaks an hour

[Data Raven | SQL, Python, Data Engineering @AssertReality]

@hashjenni It's a pie-eating competition with 1st prize: more pie!

[Data Raven | SQL, Python, Data Engineering @AssertReality]

@AstraKernel I'm going to build my entire personality around it (and disintegrate when they discontinue with 2 days notice)

[Data Raven | SQL, Python, Data Engineering @AssertReality]

I always laugh when I see a PhD looking for "industry work". Yeah, that's called an employment/job.

[Data Raven | SQL, Python, Data Engineering @AssertReality]

Dear Colleague: How am I supposed to trust any analysis you bring when you can't get my name right on Slack/in emails? I mean, the name's right there in front of you?

[Data Raven | SQL, Python, Data Engineering @AssertReality]

@emollick That's it, I'm building Chart Room in my future mansion.

[Data Raven | SQL, Python, Data Engineering @AssertReality]

@evidence_dev Very nice!

[Data Raven | SQL, Python, Data Engineering @AssertReality]

Fantastic resource on DuckDB, and it's free! Grab it now

[MotherDuck @motherduck]

Just updated the free Manning “DuckDB in Action” early access book to include Chapters 1-8. Thanks to the prolific writing of the authors, we now have chapters on MotherDuck, Python integrations and more. https://t.co/TASqCkhb1j

[Data Raven | SQL, Python, Data Engineering @AssertReality]

@merm_bot Dirty, but we've all been there

[Data Raven | SQL, Python, Data Engineering @AssertReality]

Mage now supports MotherDuck!
Can't wait to try this combo out.
https://t.co/MZkCRYh9nd

[Data Raven | SQL, Python, Data Engineering @AssertReality]

@ImLunaHey I'm confused. Should I use UUIDs as PKs on the flash cards or not? Please advise

[Data Raven | SQL, Python, Data Engineering @AssertReality]

None. There are no prompts that will land you your dream job. Only a clear goal on how to get there and relentless execution will get you there.

Go execute.

End PSA

[Data Raven | SQL, Python, Data Engineering @AssertReality]

Copy and paste these ChatGPT prompts to land your dream job

🧵:

[Data Raven | SQL, Python, Data Engineering @AssertReality]

@WarrenInTheBuff Gloves: off

[Data Raven | SQL, Python, Data Engineering @AssertReality]

Ever wanted to check whether a SQL query runs on a different DBMS? Now you can! Check out https://t.co/e6qeTSjh9D - it lets you run a query simultaneously against many of the most popular DMBS.

Best of all? It supports DuckDB, complete with a small sample database. Try it out!

[Data Raven | SQL, Python, Data Engineering @AssertReality]

@nikitabase @p_mbanugo I agree! The barrier to entry is extremely low, which inevitably will lead to widespread adoption (if the underlying product is of any use, which DuckDB certainly is)

[Data Raven | SQL, Python, Data Engineering @AssertReality]

@ImLunaHey Imma get my popcorn and just watch this unfold.

[Data Raven | SQL, Python, Data Engineering @AssertReality]

Trailing commas

A huge quality-of-life (and sanity) improvement is that DuckDB will parse SELECT statements containing trailing commas. Ditch the abominable leading comma code-styling and have peace of mind knowing that this code will run without a hitch:

[Data Raven | SQL, Python, Data Engineering @AssertReality]

More DuckDB tips and tricks!

🧵:

[Data Raven | SQL, Python, Data Engineering @AssertReality]

String slicing

DuckDB allows string slicing using the [:] notation, meaning you can select an arbitrary length of characters to strip from either the beginning or end of the string. Never know when that may come in handy!