Abstract: 

ChatGPT sparks the imagination and highlights the importance of Generative AI and foundation models as the basis for modern AI applications. However, this also brings a new set of AI operationalization challenges. Challenges like handling massive amounts of data, large scale computation and memory, complex pipelines, transfer learning, extensive testing, monitoring, and so on. In this talk, we’ll explore the new technologies and share MLOps orchestration best practices that will enable you to automate the continuous integration and deployment (CI/CD) of foundation models and transformers, along with the application logic, in production. We’ll discuss how to manage and monitor the application pipelines, at scale. We’ll show how to use GPUs to maximize application performance while protecting your investment in AI infrastructure. We’ll share how to make the whole process efficient, effective and collaborative. The session will include a live demo of transfer learning and deployment of a transformer model (using Hugging Face and MLRun).

Bio: 

Yaron Haviv is a serial entrepreneur who has been applying his deep technological experience in AI, cloud, data and networking to leading startups and enterprises since the late 1990s. As the Co-Founder and CTO of Iguazio, Yaron drives the strategy for the company’s MLOps platform and led the shift towards the production-first approach to data science and catering to real-time AI use cases. He also initiated and built Nuclio, a leading open source serverless framework with over 4,000 Github stars and MLRun, a cutting-edge open source MLOps orchestration framework. Prior to co-founding Iguazio in 2014, Yaron was the Vice President of Datacenter Solutions at Mellanox (now NVIDIA - NASDAQ: NVDA), where he led technology innovation, software development and solution integrations. He also served as the CTO and Vice President of R&D at Voltaire, a high-performance computing, IO and networking company which floated on the NYSE in 2007 and was later acquired by Mellanox (NASDAQ:MLNX). Yaron is an active contributor to the CNCF Working Group and was one of the foundation’s first members. He sits on the Data Science Committee of the AI Infrastructure Alliance (AIIA), of which Iguazio is a founding member. He is co-authoring a book on Implementing MLOps in the Enterprise for O’Reilly. Yaron presents at major industry events worldwide and writes tech content for leading publications including TheNewStack, Hackernoon, DZone, Towards Data Science and more.