Nishant | Data Engineer

Data Engineering with fomo of AI.

[Nicholas Fabiano, MD @NTFabiano]

Mentally healthy people are often delusionally optimistic.

[Nishant | Data Engineer @RandomDataGeek]

Getting the rejection email after 7 rounds of interviews hits different.

[DAN KOE @thedankoe]

At some point, usually in your 20s, you'll notice that the people around you stop believing in themselves. And no matter how hard you try, you can't save them. By all means, do not let it infect your mind. Stay on your path.

[Nishant | Data Engineer @RandomDataGeek]

Should I give this building in public another chance?

[Aryan Gupta @munna_bhai_bsms]

This is why I hate ChatGPT. It is just fine-tuned to amplify your views and opinions. Nott concerned with the truth at all

[Nishant | Data Engineer @RandomDataGeek]

The feature I love most is running upstream and downstream dependencies for a model with one command.

dbt run -m model_name+ → runs the model and its downstream dependencies

dbt run -m +model_name → runs the upstream parents and the model

[Nishant | Data Engineer @RandomDataGeek]

dbt 101 in 30 seconds 🧵👇

#dbt #dataengineering #DataAnalytics #analytics

[Nishant | Data Engineer @RandomDataGeek]

dbt CLI commands every data engineer should know:

- dbt run → builds models
- dbt test → validates data
- dbt seed → loads static data
- dbt snapshot → tracks changes

[Nishant | Data Engineer @RandomDataGeek]

Before dbt:

❌ giant SQL scripts
❌ hidden business logic
❌ broken dashboards

After dbt:

✅ modular models
✅ tested data
✅ documented metrics

This is why dbt won 🚀

[Nishant | Data Engineer @RandomDataGeek]

dbt focuses only on T in ELT.

Load data however you want. Transform it inside the warehouse using SQL + best practices.

Simple idea. Massive impact.

[Nishant | Data Engineer @RandomDataGeek]

I’m letting Google antigravity to code my “passion” project. I’m going to sleep now.

[Aravind Srinivas @AravSrinivas]

You can now track insider trading on Perplexity Finance. We will be adding politician trading shortly.

[Kevin Naughton Jr. @KevinNaughtonJr]

simply developing the discipline to do hard things repeatedly already puts you ahead of 99% of people

[Mehdi Ouazza @mehd_io]

In the SQLMesh → Fivetran → dbt story, my key takeaway:
The data world is small. Be kind to your competitors, they might be your next teammate… or your boss 😅

[Nishant | Data Engineer @RandomDataGeek]

#databrickssql

[Nishant | Data Engineer @RandomDataGeek]

Ever need to sample data without scanning everything? In Databricks SQL, use `TABLESAMPLE` in your SELECT to grab a subset of rows efficiently.

Syntax : `SELECT * FROM table TABLESAMPLE ( {percentage PERCENT} | {num_rows ROWS} | {BUCKET fraction OUT OF total} )

[Nishant | Data Engineer @RandomDataGeek]

PERCENT is very useful for dev env where you don't want to read all the data and just need to test the full flow.