3 things that transformed the landscape of analytics and data warehousing over the last 10 years are...
James Densmore in his latest book Data Pipelines Pocket Reference listed these 3 items:
1. The ease of building and deploying data pipelines, data lakes, warehouses, and analytics processing in the cloud. Thank you AWS, Microsoft, Google ;)
Do you still wonder how to secure and get enterprise readiness for #databricks?
Here's an updated set of recommendations on how to get started with #datagovernance in Databricks and #deltalake.
https://t.co/lbQoEJhKiX
I am joining @databricks webinar this Wednesday to talk about lessons learned while scaling Databricks at If Insurance
https://t.co/5o0A8KYvCe
Thanks @Junta_Nakai and Simon Ghebremikael for the invite!
#dataengineering#insuranceindustry#dataanalytics
“We use Databricks as an analytics accelerator and status quo challenger.” - @VMaksimavicius, IT Architect & Microsoft Data Platform MVP at If Insurance, discusses their decision to use Databricks for data management and how we’ve been able to help ⬇️ https://t.co/Of8ac6KRwh
Metadata is like dark matter - enormous amounts of hidden information that interact with normal, atomic, business data.
On the contrary, you can collect metadata to extract more context and meaning from your data.
https://t.co/Tg0RD3WbQv
Are you looking for a "hello world" approach for #datagovernance?
Take a look at my latest article on available metadata solutions.
p.s. @MarquezProject is a great place to start!
https://t.co/cKM5xS36FK
Here is my first article in the wider series about data governance and metadata. In them, I write about what I’ve learned on Azure Data Platform, how I think of it, and how I use that knowledge.
https://t.co/V0F3vAEPFJ
#datagovernance#metadata#azuredataplatform
I wish I could have seen this Azure Analytics Architecture earlier... 😅 Defining names of your data lake zones (raw, standardized, curated or bronze, silver, gold) is merely the tip of the iceberg
https://t.co/3Wnz58ksAL
#azure#Analytics#databricks#dataengineering#bigdata
Here is the world's simplest key value store implementation 🙂
This little masterpiece comes from Martin Kleppmann's book, Designing Data-Intensive Applications.
https://t.co/ybTevU5zTm
#dataengineering#distributedsystems#softwaredevelopment
Brilliant talk on data engineering maturity levels by Chris Riccomini. Chris presents 6 stages of data engineering, from an initial "none" stage up to a "decentralization" stage.
https://t.co/Ad1ltZjPmV
#dataengineering#bigdata#streaming
📣 My latest findings in the world of #data, #ai and #spaceexploration
AI and leadership podcasts, Google's new chat bot and more
Have you stumbled upon something interesting lately?
https://t.co/uT2kWACjZG
Greg Young, in one of his talks, encouraged programmers to read scientific papers. But how do you get access to SpringerLink, EBSCO, Cambridge Journals, or other databases? My go-to place is Martynas Mazvydas National Library. What are your favorite journals on software, data?