Ivan Lee
CEO at Datasaur, Inc
Ivan Lee graduated with a Computer Science B.S. from Stanford University, then dropped out of his master’s degree to found his first mobile gaming company Loki Studios. After raising institutional funding and building a profitable game, Loki was acquired by Yahoo. Lee spent the next 10 years building AI products at Yahoo and Apple and discovered there was a gap in serving the rapid evolution of Natural Language Processing (NLP) technologies. He built Datasaur to focus on democratizing access to NLP and LLMs. Datasaur has raised $8m in venture funding from top-tier investors such as Initialized Capital, Greg Brockman (President, OpenAI) and Calvin French-Owen (CTO, Segment) and serves companies such as Google, Netflix, Qualtrics, Spotify, the FBI and more.
All Sessions by Ivan Lee
LLM-native Products: Industry Best Practices and What's Ahead
<span class="etn-schedule-location"> <span class="firstfocus">Large Language Models</span> </span>Ai X Talk: The next generation of LLM-powered products will not look and feel like ChatGPT. ChatGPT captured everyone's imagination because it could do everything - suggest international travel plans, generate ideas for dates, and analyze lengthy legal contracts. Now companies are building AI models that are more narrowly focused and must avoid the recurring issues of hallucination and non-deterministic answers. The mistakes made by ChatGPT and its successors pose much greater business risks for the enterprise. An incorrect answer to a simple math problem or directions to a cafe that doesn't exist might make the news as a silly, laughable mistake. But a customer socially engineering a model to ask about confidential pricing documents, or an employee poking around HR performance reviews could result in a PR fiasco. In August 2023, a generative AI for recipes mistakenly produced a recipe that was poisonous to humans. As an NLP practitioner of over a decade, I have experience working with Fortune 100 companies and actively observe trends in how they are seeking to deploy LLM/GenAI technologies. This talk will explore the business objectives LLMs are most suited to address across all industries, and how organizations ranging from healthcare to eCommerce are leveraging this new technology to increase revenue or cut costs. We will also discuss how to avoid common pitfalls organizations make in scoping and building their projects, how to set reasonable goals and milestones for executive sponsors, and look ahead to a future where LLMs ubiquitously power all our day-to-day applications behind the scenes.
Going Small: Twice as Fast and a Third Cheaper with Model Distillation
<span class="etn-schedule-location"> <span class="firstfocus">Generative AI</span> <span class="secfocus">Intermediate</span> </span>In the era of large language models (LLMs), Small Language Models (SLMs) are emerging as powerful alternatives for specialized tasks. This workshop explores the potential of SLMs and demonstrates how a collection of fine-tuned SLMs can often outperform a single multi-purpose LLM for many use cases. Workshop Highlights: Model Distillation: Learn how to distill the intelligence of an open-source large language model (Llama 3.1 405B) into a smaller, more efficient model (Llama 3.1 8B). Performance Optimization: Discover techniques to maintain quality and accuracy while achieving: 3x increase in processing speed 66% reduction in operational costs Real-world Application: Using an open-source healthcare dataset, we'll demonstrate how to leverage the expertise of the 405B model to fine-tune the 8B model for specialized medical tasks. Hands-on Experience: Follow a step-by-step guide to create your own production-ready 8B model, tailored for specific use cases. By the end of this workshop, participants will have practical knowledge of SLM fine-tuning and distillation techniques, enabling them to create powerful, efficient, and domain-specific language models for their unique applications.
The 2025 Shift to Smaller Models: Why Specialized AI Will Win
<span class="etn-schedule-location"> <span class="firstfocus">LLMs</span> <span class="secfocus">All Levels</span> </span>The initial excitement surrounding large language models (LLMs) is giving way to a new reality: the era of rapid, disruptive improvements is waning. As enterprises transition from proof-of-concept to production deployments, the spotlight is turning to smaller, specialized models. This presentation argues that fine-tuned and distilled SLMs, optimized for specific tasks and datasets, will constitute the vast majority of deployed generative AI applications. Attendees will learn the critical trends driving this shift, gain practical guidance for building with SLMs, and receive insights into the future of GenAI in the enterprise.
Virtual Only: Solution Showcase: Intelligent NLP Data Annotation: Boosting Efficiency and Quality with Advanced Techniques
<span class="etn-schedule-location"> <span class="secfocus">All Levels</span> </span>Manual data annotation for NLP tasks is increasingly being augmented by intelligent techniques. This presentation delves into several key approaches for enhancing annotation workflows, including LLM-powered labeling, data programming strategies, and automated error correction. Drawing on 15 years of experience in the field, we share best practices and lessons learned, demonstrating how these intelligent approaches can boost annotation efficiency and quality by up to 75%.
Virtual Only: Solution Showcase: Intelligent NLP Data Annotation: Boosting Efficiency and Quality with Advanced Techniques
<span class="etn-schedule-location"> <span class="secfocus">All Levels</span> </span>Manual data annotation for NLP tasks is increasingly being augmented by intelligent techniques. This presentation delves into several key approaches for enhancing annotation workflows, including LLM-powered labeling, data programming strategies, and automated error correction. Drawing on 15 years of experience in the field, we share best practices and lessons learned, demonstrating how these intelligent approaches can boost annotation efficiency and quality by up to 75%.
The 2025 Shift to Smaller Models: Why Specialized AI Will Win
<span class="etn-schedule-location"> <span class="firstfocus">LLMs</span> <span class="secfocus">All Levels</span> </span>The initial excitement surrounding large language models (LLMs) is giving way to a new reality: the era of rapid, disruptive improvements is waning. As enterprises transition from proof-of-concept to production deployments, the spotlight is turning to smaller, specialized models. This presentation argues that fine-tuned and distilled SLMs, optimized for specific tasks and datasets, will constitute the vast majority of deployed generative AI applications. Attendees will learn the critical trends driving this shift, gain practical guidance for building with SLMs, and receive insights into the future of GenAI in the enterprise.
Going Small: Twice as Fast and a Third Cheaper with Model Distillation
<span class="etn-schedule-location"> <span class="firstfocus">Generative AI</span> <span class="secfocus">Intermediate</span> </span>In the era of large language models (LLMs), Small Language Models (SLMs) are emerging as powerful alternatives for specialized tasks. This workshop explores the potential of SLMs and demonstrates how a collection of fine-tuned SLMs can often outperform a single multi-purpose LLM for many use cases. Workshop Highlights: Model Distillation: Learn how to distill the intelligence of an open-source large language model (Llama 3.1 405B) into a smaller, more efficient model (Llama 3.1 8B). Performance Optimization: Discover techniques to maintain quality and accuracy while achieving: 3x increase in processing speed 66% reduction in operational costs Real-world Application: Using an open-source healthcare dataset, we'll demonstrate how to leverage the expertise of the 405B model to fine-tune the 8B model for specialized medical tasks. Hands-on Experience: Follow a step-by-step guide to create your own production-ready 8B model, tailored for specific use cases. By the end of this workshop, participants will have practical knowledge of SLM fine-tuning and distillation techniques, enabling them to create powerful, efficient, and domain-specific language models for their unique applications.
LLM-native Products: Industry Best Practices and What's Ahead
<span class="etn-schedule-location"> <span class="firstfocus">Large Language Models</span> </span>Ai X Talk: The next generation of LLM-powered products will not look and feel like ChatGPT. ChatGPT captured everyone's imagination because it could do everything - suggest international travel plans, generate ideas for dates, and analyze lengthy legal contracts. Now companies are building AI models that are more narrowly focused and must avoid the recurring issues of hallucination and non-deterministic answers. The mistakes made by ChatGPT and its successors pose much greater business risks for the enterprise. An incorrect answer to a simple math problem or directions to a cafe that doesn't exist might make the news as a silly, laughable mistake. But a customer socially engineering a model to ask about confidential pricing documents, or an employee poking around HR performance reviews could result in a PR fiasco. In August 2023, a generative AI for recipes mistakenly produced a recipe that was poisonous to humans. As an NLP practitioner of over a decade, I have experience working with Fortune 100 companies and actively observe trends in how they are seeking to deploy LLM/GenAI technologies. This talk will explore the business objectives LLMs are most suited to address across all industries, and how organizations ranging from healthcare to eCommerce are leveraging this new technology to increase revenue or cut costs. We will also discuss how to avoid common pitfalls organizations make in scoping and building their projects, how to set reasonable goals and milestones for executive sponsors, and look ahead to a future where LLMs ubiquitously power all our day-to-day applications behind the scenes.
