Key Design Principles of Modern Data Platforms (feat. Airbyte, dbt, Snowflake and Dagster).

Abstract: 

The modern data stack is a highly debated topic with practitioners having differing views on tools and architecture. In this talk, I cut through the noise and focus on key design principles that will help YOU decide on tooling and architecture that works best for your use-case.

To illustrate the design principles, I will be doing a live demo of an end-to-end ELT pipeline using Airbyte, dbt, Snowflake and Dagster.

Fasten your seatbelts as I take you on a journey through past, present and the future.

Bio: 

Jonathan is an Analytics Engineer at Canva where he is building data platforms to empower product teams to unlock insights from millions of users.
He has previously worked at EY, Telstra Purple, and Mantel Group, where he has led data engineering teams, built data engineering platforms for ASX-100 customers, and developed new products and businesses. Since 2020, Jonathan has trained over 100 students through data analytics bootcamps and courses. In 2022, he founded Data Engineer Camp, a 14-week data engineering bootcamp that empowers professionals to become data engineers with the modern data stack.
He also hosts the Perth Data Engineering monthly meetup group with over 300 members.

Open Data Science

 

 

 

Open Data Science
One Broadway
Cambridge, MA 02142
info@odsc.com

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Youtube
Consent to display content from Youtube
Vimeo
Consent to display content from Vimeo
Google Maps
Consent to display content from Google