Abstract: The modern data stack is a highly debated topic with practitioners having differing views on tools and architecture. In this talk, I cut through the noise and focus on key design principles that will help YOU decide on tooling and architecture that works best for your use-case.
To illustrate the design principles, I will be doing a live demo of an end-to-end ELT pipeline using Airbyte, dbt, Snowflake and Dagster.
Fasten your seatbelts as I take you on a journey through past, present and the future.
Bio: Jonathan is an Analytics Engineer at Canva where he is building data platforms to empower product teams to unlock insights from millions of users.
He has previously worked at EY, Telstra Purple, and Mantel Group, where he has led data engineering teams, built data engineering platforms for ASX-100 customers, and developed new products and businesses. Since 2020, Jonathan has trained over 100 students through data analytics bootcamps and courses. In 2022, he founded Data Engineer Camp, a 14-week data engineering bootcamp that empowers professionals to become data engineers with the modern data stack.
He also hosts the Perth Data Engineering monthly meetup group with over 300 members.