@NammaBESCOM
In Solaris, Bannerghatta Road, Gottigere.
120 families paid their electricity bills.
30 empty flats didn’t.
Result? Power cut to the entire building.
Since when are individual consumers liable for others’ dues?
This feels like extortion.
We are running on generator
Data lakes are just files on someone else’s computer!
Just like any file system, we should have a way to manage them and not just throw everything on Desktop and call it a day.
Files are managed with a metadata layer, usually this is Iceberg, Delta Lake or Hudi!
These technologies give you access to the first “folder” mechanism of data lakes which is called a table.
Most tables need additional folders though to maximize data retrieval efficiency!
You can have an additional folder on a table and that’s called a partition.
Partitions generally happen on the time dimension of your data. Date partitioning is ubiquitous across industry!
Sometimes you need additional folders even after partitioning on date to improve access to your data sets. These are called sub partitions!
For example, when I worked in notifications at Facebook, we partitioned on date and channel. Channel being SMS, email or push. This allowed analysts to look at just SMS or email notifications without having to read all the push notifications too!
I recently made a free YouTube video covering all these data lake fundamentals and file compression too!
https://t.co/pm5pjkyM7d
Check it out! I greatly appreciate y’all’s support!
#dataengineering
Baracara; A Village in Caribbean and so remote that it takes around 2 days by boat to go there from New Amsterdam...
The village has population of roughly 350 people and internet reached there in 2018 only...
There was a guy who grew up there and then started working as a labourer and then as a security guard (with 12 hour shift)
The guy went on to make his International debut and dismissed Steven Smith with his first ball in International Cricket but what he did today...it should be preserved and must use to show to future generations that what Test cricket is meant to a player and to the fans across the world...
Shamar Joseph...
I can say that by my childhood experience that Runs,wickets,big pay contracts, trophies nothing matters as much as what you did today...you inspired generations with one single spell today...
*Respect*
Gotta feel for Steven Smith for his heroic efforts though but that's Cricket...so near yet so far on some occasions...
#AUSvsWI
1/Math for Machine Learning and Data Science is now available on Coursera! Taught by @luis_likes_math, this gives an intuitive understanding of the most important math concepts for AI.
https://t.co/WFi3KSuVk7
A racoon passes by my leg as I watch the sunset near the ocean. I talk to my friend about our Prof's work highlighted during Google IO. Researchers are biking back from their labs. Louis Vuitton has a private fashion show going in a distant building.
Welcome to UC San Diego!
🤓In 2017, Google researchers introduced the Transformer in "Attention is all you need", which took AI by storm.
5 startups were born: @AdeptAILabs (🏦 @airstreet), Inceptive, @NEARProtocol, @CohereAI, CharacterAI.
Only 1/8 authors remain @GoogleAI, another is at @OpenAI.
😉
Completed my viva on DevOps, where I explained to the teachers in length what Git & Github was along with the commands.
Just 5 minutes later the next teacher I met asked me to transfer my final year project code to her on a Pen drive 👀
🏆D47 to D50 of #100DaysOfCode :
Halfway of 100daysofcode🦸♂️
▶ Solved quite a few interesting Problems on LeetCode mostly on the topic Binary Search. Will link the problems in a subsequent tweet.
▶ Worked on a Music Library Project in C for my Data Structures Capstone Project!