How to Build a Domain-Aware Assistant with LLM Agents: Combining Reasoning and Knowledge with RAG


Generative models like GPT-4, Claude, and PaLM have high levels of coherence and amazing reasoning capabilities, but they model knowledge "implicitly," making them vulnerable to breaking down in out-of-domain settings. To build a conversational assistant / chatbot that is aware of new, domain-specific knowledge, we will explain the necessity of Retrieval Augmented Generation (RAG) and the role of domain-adapted hybrid semantic search. We will also explain how RAG approaches also protect against the privacy and sensitivity implications of fine-tuning generative models, by applying permissions at the appropriate input layer. We will also overview how LLM Agents and a Tool framework build off of RAG to increase the space of solvable workflows and intents.

Learning objectives: Generative AI, LLMs, RAG, semantic search, LLM agents


Eddie joined Glean as a founding engineer. He leads a team of engineers and AI experts at Glean who work on challenging problems across Machine Learning, LLMs, NLU, domain adaptation, semantic search, and much more in order to build the world’s best work assistant. Previously, he worked as a research and software engineer for Google, contributing to a number of major projects, including natural language and semantic solutions. His current mission is to leverage AI and NLP technology to create the enterprise solution that speaks the language of each individual workplace.

Open Data Science




Open Data Science
One Broadway
Cambridge, MA 02142

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Consent to display content from - Youtube
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google