manoj sahu

Software Engineer | love coding | like singing, playing Guitar and doing what I like.....

[manoj sahu @manojsahu39]

@airtelindia @Airtel_Presence @airtelnews
It’s been more than 24 hours now and my broadband issue is not resolved yet. U claimed to be the fastest provider, but ur services are slower than a tortoise 🐢
Req ID 11042932160

[DK Shivakumar @DKShivakumar]

It is deeply disturbing to see the visuals from Jamui, Bihar, showing two Class 10 students being harassed, assaulted and humiliated. The courage shown by the young boy in standing by the girl in such a frightening situation deserves appreciation, as does the upbringing that taught him to stand up for another person’s dignity. Our youth should have the courage to stand up for what is right. The arrests made so far are welcome, but every person responsible must face strict legal action to ensure that the two young victims receive justice and can move forward with dignity and without fear.

[manoj sahu @manojsahu39]

@bigdatasumit There is no doubt in your course sir. 😎

[St. Broseph @St_Brosephs]

Hello @SantoshSLadINC sir,

As you know, following the death of Medha Akarsh due to poor road conditions in Hebbagodi, a group of local, concerned citizens had come together for a peaceful spontaneous protest demanding accountability from concerned officials.

It was truly a peaceful protest with some slogans, and now as per multiple reports, the Hebbagodi Police Station is contacting common citizens who participated in that protest and are threatening them with punitive actions only because they dared to raise their voices in the wake of a young woman's death.

Why should FIRs be filed against common citizens for simply raising their voices? Article 19 of the Indian constitution specifically grants citizens the right to protest.

I am aware that due to the Licensing and Regulation of Protests, Demonstrations and Protest Marches (Bengaluru City) Order, 2021, protests in Bengaluru City are restricted to Freedom Park only, but Hebbagodi comes under the Hebbagodi City Municipal Council and not under any limit that could be considered as "Bangalore City"

So these actions of @HebbagodiPS to threaten and punish common citizens for protesting are unconstitutional, undemocratic, and have absolutely no legal basis whatsoever.

I request your intervention in this, and also the attention of @DCP_ECITY and @BlrCityPolice to stop the harassment of citizens with immediate effect

I implore you to instead redirect the focus and might of our police force into investigating the circumstances leading to Medha's death so that all those culpable and responsible can be punished to the fullest extent of the law.

#JusticeForMedhaAkarsh

[Sumit Mittal @bigdatasumit]

Delete 1 Row. Databricks Rewrites 10 GB

That's expensive, especially at scale.

In this short, I explain how Deletion Vectors changed that by making DELETE, UPDATE, and MERGE operations significantly more efficient in Delta Lake.

If you work with Apache Spark or Databricks, this is a feature you should definitely understand.

#dataengineering

[manoj sahu @manojsahu39]

@bigdatasumit Sir, This year you have to invite more than 100 students to the get together function😎

[manoj sahu @manojsahu39]

@AyurvedaMonk @AshwiniVaishnaw @RailMinIndia @IRCTCofficial IRCTC tatkal booking sucks. I have never been allotted with seat. The spinner will keep on loading and then you will see WL.

[manoj sahu @manojsahu39]

@bigdatasumit No doubt when people have courses launched by Sumit Mittal sir 😎

[manoj sahu @manojsahu39]

@mrsnhl Please connect with @St_Brosephs
They will help you in this matter.

[manoj sahu @manojsahu39]

@CommrPR
I submitted my E-Khata transfer application #30043620 on January 13, 2026, but there has been no update on its status. Despite multiple follow-up emails and phone calls, I haven't received any response. Could you please assist?

[manoj sahu @manojsahu39]

@bigdatasumit This is amazing 🤩

[Sumit Mittal @bigdatasumit]

2026 Data Engineering Roadmap
How to become a Good Data Engineer

Every year I get this question.
What should I learn to become a good Data Engineer?

Let me put this in a very simple and practical way.

Prerequisites
- Programming fundamentals
- SQL basics

Without these two, everything else becomes difficult.

I have playlists for both the prerequisites on my youtube channel.

Once this is clear, you should focus on the following.

Core Data Engineering Skills
- Distributed computing fundamentals
- You must understand why systems are distributed and how they scale.

Data lake concepts
- File formats, partitions, schema evolution, storage vs compute separation.

One data ingestion tool
- Batch and incremental ingestion patterns are far more important than tool names.

Data warehouse concepts
- Facts, dimensions, modeling, query optimization, cost awareness.

In-memory computation using Apache Spark
PySpark with transformations, actions, joins, shuffles, and performance tuning.

Structured streaming with Kafka
Real-time pipelines, exactly-once semantics, watermarking, late data handling.

One cloud platform
- AWS or Azure or GCP is enough.
- Multi-cloud knowledge is always an add-on, not a requirement.

Integration of components
How ingestion, processing, storage, orchestration, and analytics fit together.

CI/CD for data pipelines

Projects
Do at least two end-to-end projects.
This is where everything starts making sense.

Below things in Azure Cloud are very trending
- ADLS Gen2
- Azure Databricks
- Azure Data Factory

In AWS, you can focus on
- S3, Glue, Athena, EMR, Redshift, EC2, Lambda

If you have 8+ years of experience
Shift your focus to Design decisions, Performance tuning, Cost optimization

If you are targeting top product-based companies
- Data Structures and Algorithms matter.
- Arrays, Linked Lists, and Trees are usually sufficient.

Finally, a very important point.

Do not learn only for interviews.
Learn to build systems that work in real life.

If you understand internals,
interviews automatically become easier.

If you want confidence,
watch a few mock interviews on my YouTube channel.
That is usually the final validation people need.

Just to mention Databricks has evolved as an end to end Data Engineering platform and has super high demand. Learn it well.

If I missed anything, feel free to add it in the comments.

I follow a very similar roadmap in my Ultimate Big Data Program.
A new batch is starting on coming Saturday. DM me if you want details.

#bigdata #dataengineering #roadmap

[manoj sahu @manojsahu39]

@bigdatasumit Indeed sir. Add me also to your student list transitioning from one platform to another. I wanted to be part of the Taj party in 2026 😊

[Sumit Mittal @bigdatasumit]

2025 wasn’t about noise. It was about impact.

Grateful to close 2025 with milestones that truly mattered:

-Updated & delivered my most popular Ultimate Data Engineering Masters Program.

-Helped 1000's of professionals transition into Data Engineering & Big Data roles this year.

-Students cracked offers at Visa, Walmart, Microsoft, Databricks, American Express, Deloitte, & 100 more companies.

-Multiple learners achieved 100% - 300% salary hikes at Senior & Lead levels.

-Created Gen-AI Masters Program, which is getting amazing response.

-Celebrated my students Success with a dashing party at Taj, Bangalore.

-Released a 50-Day Free SQL Champion Course on YouTube - 15,000+ learners enrolled so far.

-Reached 3 lakh+ subscribers on LinkedIn and 1.5 lakh+ on YouTube.

-Joined Samyak Infotech as Data Engineering & AI Advisor.

Looking back, the highlight isn’t numbers.

It’s messages that say,
"I finally understand this.
"I cracked the interview."
"I changed my career."

Thank you to every learner, almighty, family, my team and well-wisher who trusted the journey.

2026 will go deeper.

More practical engineering.
More honest guidance.
More lives changed through skill.

Wishing everyone a Happy, Healthy & High-Growth New Year!

[manoj sahu @manojsahu39]

@RapidoCares @sankaaravind
Seems like u have started a new scam to cheat customers from BLR T1 airport. Driver misbehaved & asked my wife to pay extra 4 parking and toll, however Toll was already included in the bill. Rapido customer support sucks.

[Sumit Mittal @bigdatasumit]

Let me explain Deletion Vectors in a way like never before!

The cheapest delete is the one that skips rewriting the book.

A teacher keeps an attendance register.
One student leaves.

Old way
Rewrite the whole page without that name.
Slow and wasteful.

New way
Put a small mark next to the name that says "do not count."
Fast and simple.

That small mark is a deletion vector.

Reads ignore the marked names.
Writes do not waste time rewriting whole pages.

If too many marks build up, the teacher cleans the register on a quiet afternoon.
That is REORG and OPTIMIZE.
VACUUM clears the old clutter.

Daily rule
Use marks for small frequent changes.
Do a tidy up when marks start slowing reading.

Deletion vectors are tiny marks that save big work. The cleanup is a scheduled habit, not an emergency.

#DeltaLake #Databricks

[manoj sahu @manojsahu39]

@airtelindia @Airtel_Presence
It seems like you don’t bother of the tickets created by customers, no matter how the customer might be dealing without wifi connectivity? I requested the technician to resolve today but he denied.

[Sumit Mittal @bigdatasumit]

I asked my team member to give me one decent resume.

I got one resume,

I checked the ATS score, it was 38

I did a lot of research over the past few days,

I made multiple changes, without using any AI software (to strike the right balance between the ATS score & human readability)

Guess what? I was able to take the score to 100,
However any score above 80 is a really good score.

Over this entire process I got a lot of good insights and recorded a couple of sessions to demonstrate the same step by step.

I'm giving you free access to these session where I will show how to optimize your resume & take the ATS score from 38 to 100.

yes you heard it right, a fully ATS compliant resume with 100 score.

To get, just:
- Follow me (So that I can DM you)
- Like & Repost
- Comment Interested

Note - This access will be given for 3 days!

Remember that a high ATS score can help you get 10X more Interview calls.

This is very interesting stuff!

#resume #job #jobhunt #dataengineering

[manoj sahu @manojsahu39]

@bigdatasumit I really appreciate the effort you put in for Data engineers. However, in current situation, every one is asking questions on real time scenarios which becomes difficult to answer when don’t have realtime exposure sir.

[Sumit Mittal @bigdatasumit]

To all the Recruiters hiring for Data Engineering Roles.

I have brilliant candidates who have gone through my Extensive Data Engineering Program.

Many of them are already working as Data Engineers.

whether you are looking for someone at
- entry level
- senior/lead position
- architect position
- leadership roles

you can find really good talent from my students.

Do reach out to me if you have any of these requirements.

To all my students, please repost this as much as you can so that this can reach to the right set of people who are hiring.

#dataengineering #hr #recruiters #hiring