Netflix is excited about the upcoming Data Engineering Open Forum, set for April 18th. This full-day, in-person conference will be held at our Los Gatos office. π―
#Netflix#data#deforum#dataengineering#netflixdata
π Abhinaya Shetty and Bharath Mummadisetty from Netflix's Membership Data Engineering team unveil Psyberg, an incremental ETL framework. Find out how Psyberg harnesses Iceberg metadata to handle late-arriving data, making on-call duties a breeze! π¬ https://t.co/FRDjO034ik #data
π¨ Gain insights on building rock-solid data pipelines with Holden Karau as Holden talks about the importance of reliability and provides tools for testing, validation, and auditing using Apache Spark as an example.https://t.co/AmqpcWwTqS #DataPipelines#NetflixDESummit23#data
π’ Get an inside look into Netflix Data Engineering, where Chris Stephens & Pedro Duarte walk through the building blocks of the data stack. Batch and streaming pipelines won't be a mystery anymore. π https://t.co/7DdkCe0tm2 #DataEngineering#NetflixDESummit23
π Dive deep into unlocking new Stream Processing use cases with Streaming SQL on Data Mesh using Apache Flink, presented by Mark Cho, Guil Pires, & Sujay Jain in Netflix's DE Summit 2023 π https://t.co/98XwwxU5Q9 #ApacheFlink#NetflixTech#NetflixDESummit23
Netflix will be hosting the Data Engineering Open Forum on April 18th: a full-day in-person conference at our Los Gatos office!
If you are interested in speaking at the conference, please fill out the CFP form:
https://t.co/nmfSfXGOiy
#data#Forum
Discover Netflix's Incremental Processing Solution (IPS) using Netflix Maestro & Apache Iceberg. IPS results in cost-effective data processing, data accuracy, data Freshness & handled backfills, key to addressing our core business needs. #dataengineering
https://t.co/MUosyjv7lN
Love our Top 10 Lists but want to dig deeper?
Starting today, Netflix will release a twice yearly engagement report showing hours viewed for our original and licensed titles in the previous six months.
The first list is here and covers Jan to June β23: https://t.co/3VIBUwyxpI
Unlocking the full power of Psyberg! Explore how we automate and streamline end-to-end data pipeline catch-ups at Netflix, turning late-arriving data challenges into proactive, efficient solutions. Feel the impact! #DataEngineering#NetflixTechBlog
https://t.co/ciLaTx0RWQ
Dive into the intelligence of Psybergβs two operational modes, powering Netflixβs data pipelines. Whether Stateful or Stateless, learn how we ensure accuracy and timeliness in our data processing. #DataEngineering
https://t.co/0aZ5LOBWFC
Discover how Netflix's Membership and Finance Data Engineering team tackles the challenges of incremental data processing with late-arriving data using Psyberg, an innovative incremental processing framework developed in-house! #TechBlog#Netflix#Data
https://t.co/0fVOTEWSU7
Heads up on a great talk coming up on March 9th at Elevate 2023: https://t.co/IoYGLtfo7g
"Engineering Data for Data Quality" by @xinran_waibel
@GirlGeekX
They will share lessons learned from building web-scale data systems at Netflix and major trade-offs to consider when migrating from batch to event streaming
Migrating from batch data pipelines to real-time? Can't decide if event streaming is the right choice for your data? Check out the upcoming talk from Netflix's data engineers @xinran_waibel and @VB_in_space at Current 2022 on Oct 4-5: https://t.co/Kp775jZ1mW