Abstract: 

This can be either a talk or a workshop, depending on how much time you have. This session aims to provide hands-on, engaging content that gives developers a basic understanding of Llama 2 models, how to access and use them, build core components of the AI chatbot using LangChain and Tools. The audience will also learn core concepts around Prompt Engineering and Fine-Tuning and programmatically implement them using Responsible AI principles. Lastly, we will conclude the talk explaining how they can leverage this powerful tech, different use-cases and what the future looks like.

Session Outline:

Section 1: Understanding Llama 2 and its usage
Familiarize yourself with Llama 2 models, how to download, install and access them, and basic use-cases it can accomplish. Additionally, we will also review basic completion, system prompts and responses in different formats.

Section 2: Generative AI Application Architecture
We will walk through the basic Gen AI & Chatbot architecture including implement chat requests, responses, prompt engineering concepts to get the best out of Llama, Hallucinations and how to prevent them, augmenting external data using Retrieval Augment Generation (RAG) principles and implement all of this using LangChain. We will also review advanced concepts around Fine-Tuning.

Section 3: Responsible AI and Future
We will walk through the basic Responsible AI considerations as you build your Generative AI strategy and applications, safety measures to address context specific risks, best practices for mitigating potential risks and more. We will also walk through what the future lies in Generative AI space and give you glimpse of what to expect from Llama offerings.

Background Knowledge:

Attendees will have deeper understanding of Llama 2, basic concepts of Gen AI. They will be able to access Llama 2 and use it in their day-to-day Generative AI projects and applications.

Basic knowledge of LLMs and Python

Bio: 

Amit Sangani is the Director of Partner Engineering leading the Applied AI Platforms team at Meta. Amit has been with Meta for 8+ years and manages developer-facing engineering teams working on Gen AI platforms such as Llama 2 and PyTorch. Amit’s mission is to democratize AI and increase the adoption of these platforms by making it easier for developers to integrate them into their products and spur innovation and increased productivity.