Proactive Data Quality: Why Culture Comes Before Tools

Abstract: 

This talk is for data engineers and scientists who are interested in the art of data quality. Too often, data reliability is centered on finding what was already broken. Meanwhile, many data quality issues result from bugs introduced in the code that processes data and can be prevented with better testing pre-production.

We will discuss why the cultural shift from “How fast can I find and fix pipeline issues?” to “How can I prevent 90% of my pipeline issues from occurring in the first place?” is critical to achieving consistent data quality. This talk also explains why data engineers and scientists need to undertake this cultural shift in thinking before seeking out tooling (and not the other way around).

By attending this session, you’ll understand:

1. Why achieving data quality is so difficult
2. Why proactive data QA processes are the foundation of true data quality
3. How data catalogs and lineage can be used to enhance stakeholder relationships and build more trust

Bio: 

Bio Coming Soon!

Open Data Science

 

 

 

Open Data Science
One Broadway
Cambridge, MA 02142
info@odsc.com

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Youtube
Consent to display content from Youtube
Vimeo
Consent to display content from Vimeo
Google Maps
Consent to display content from Google