Dive into Data: The Future of the Single Source of Truth is an Open Data Lake

Abstract: 

In this talk, I will take you on a journey building a centralized data repository that ingests from a wide variety of sources - e.g. service databases, SAAS applications, unstructured files, and conversational data. I give real life examples on how migrating from proprietary data warehouses to an open data lake dramatically reduced cloud costs and vendor lock-in, how cloud file targets decoupled compute from storage and improved data pipeline efficiency. I focus on the EL of extract, load, transform and the scalability of open table formats. I conclude with UniForm, the hope to end the “battle of metastores”, and the future state of data lakes. My insights can help you choose the most appropriate technology to accommodate diverse analytics, machine learning, and product use cases.

Session Outline:

I hope the audience is empowered to choose open source technology and open table format. https://delta.io/for the UniForm project

Bio: 

Christina is passionate about open source, multi-cloud, scalable and efficient data pipelines. She makes data informed architectural decisions to build modern systems that support advanced analytics, machine learning, and customer facing product use cases. She has a keen interest in interdisciplinary areas such as DevOps, MLOps and Cloud FinOps. She loves to learn, share and contribute to the open source community.

Open Data Science

 

 

 

Open Data Science
One Broadway
Cambridge, MA 02142
info@odsc.com

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Youtube
Consent to display content from - Youtube
Vimeo
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google