Abstract: Smart Cities are complex and challenging environments. They generate an overwhelming amount of data that you have to ingest, transfer, prepare and store even before thinking of analyzing them or training a model. In this presentation based on a fictitious but concrete scenario, in the city of London, we will see how you can leverage different data engineering patterns to create a full edge-to-core data pipeline. All of these: Computer Vision, Kafka, Object Storage, Data aggregation, Real-time and Batch analysis, in a fully cloud-native containerized environment, are some of the technologies we will explore and see working live.
After this session, you should get a better understanding on how to get your models in production, how to automate some data engineering workflows, and how to build a resilient production-grade data workflow infrastructur
Bio: Guillaume Moutier is a Sr. Principal Data Engineering Architect at Red Hat, focusing his work on data services, AI/ML workloads and data science platforms. Former CTO of Laval University in Canada, he is constantly looking for and promoting new and innovative solutions, but always with a focus on usability and business alignment brought by 20 years of IT management experience