Mastering Real-time Processing While Effectively Scaling Data Quality with Lambda or Kappa Architecture


In a world that creates 2.5 quintillion bytes of data every day, auditing data at scale becomes a challenge of unprecedented magnitude. ‘Mastering Real-time Processing while effectively scaling Data Quality with Lambda or Kappa Architecture’ provides a deep-dive into powerful methodologies, revealing design patterns that turn this challenge into an opportunity for businesses. Join us as we navigate the complexities of data audits and discover how leveraging these techniques can drive efficiency, reduce latency, and deliver actionable insights from your data - at any scale.


As a seasoned Senior Data Engineer, I bring over 8 years of immersive experience in the dynamic realm of large-scale data engineering. With a proven track record, I specialize in developing robust streaming and batch processing pipelines, constructing comprehensive data lakes, and implementing cutting-edge data engineering practices within organizations.

Currently, I am spearheading transformative projects at Netflix as part of the Open Connect team. Here, I am tasked with architecting and deploying large-scale real-time and batch pipelines. These pipelines serve as the backbone for Netflix's Open Connect data, which is instrumental in optimizing various facets of video streaming. From enhancing streaming algorithms to refining CDN-level TCP connections, my contributions are pivotal in elevating user experience and operational efficiency.

Prior to my tenure at Netflix, I held similar roles at Twitter and Doordash, where I leveraged my expertise to drive impactful initiatives that fueled innovation and growth.

In essence, my career is defined by a relentless pursuit of excellence and a passion for leveraging data to solve complex challenges. With each project, I aim to push boundaries, deliver tangible results, and shape the future of data engineering in the digital landscape.

Open Data Science




Open Data Science
One Broadway
Cambridge, MA 02142

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Consent to display content from - Youtube
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google