Last Friday I graduated from my Data Engineering programme with ALX.
A year ago, I signed up not knowing what a pipeline was. Today I build them.
It started with 13 weeks of Professional Foundations, where I learnt communication, time management and the GRIT mindset.
Week 4 at @analystlabafric is done. I cleaned and standardised a consumer complaints dataset with SQL in Postgres, defined 12 KPIs, and built a four page Power BI dashboard with insights and recommendations. Clean data first, charts second. #DataAnalytics
Week 3 of my data analytics internship with @analystlabafric is done. I built a Healthcare Operations and Financial Intelligence Dashboard, ran data quality checks, validated my numbers with SQL and shared recommendations. Biggest lesson: question your data before you trust it.
I also finished the ALX freelance course, then went into 16 weeks of Data Engineering with Kafka, Airflow, Docker and Spark.
That is 52 weeks of showing up.
There was self doubt, setbacks and days I wanted to quit. Grit kept me going.
I got into the @analystlabafric Data Analytics Internship this month.
Week 1 is done: business questions and recommendations using Excel. I had not touched Excel in a while and it was a struggle, but I pushed through.
Documenting every week. See you next week.
#DataAnalytics
Week 14 of data engineering: data quality with Spark.
The scariest bug is not a crash. It is a pipeline that keeps running and gives wrong results that look correct.
2yrs after my mom died, i sat down one day & i started crying
prolly the last time i was able to shed out tears!! i couldn’t remember her voice & her face was fading little by little(cos i had to think well to remember every detail)…. i felt like i failed her & i’m a uselessss
today 11yrs ago, she died & lmfaoo it sill hurts the same way like when i got the call in my room at school to come home urgently!! rest in peace my forever love
I also learnt to read the Spark UI, spot high garbage collection time, and debug errors like OutOfMemoryError, which I hit myself.
Slow queries mean slow fraud detection, and now I know where to look.
Week 14, let’s go.
#DataEngineering#FraudDetection#ALX#ALXAfrica
Week 13 was all about making Spark fast.
I learnt why caching matters. Instead of rebuilding the same data for every check, you tell Spark to save it once. I learnt how a shuffle really works, what serialization means, and how RDDs and DataFrames are related.