Deep Reinforcement Learning in the Real World: From Chip Design to LLMs with Anna Goldie
Reinforcement learning (RL) is famously powerful but difficult to wield, and until recently, had demonstrated impressive results on games, but little real-world impact. Anna Goldie will start the talk with a discussion of RL for Large Language Models (LLMs), including scalable supervision techniques to better align models with human preferences (Constitutional AI / RLAIF). Next, she will discuss RL for chip floorplanning, one of the first examples of RL solving a real-world engineering problem. This learning-based method can generate placements that are superhuman or comparable on modern accelerator chips in a matter of hours, whereas the strongest baselines require human experts in the loop and can take several weeks. This method was published in Nature and used in production to generate superhuman chip layouts for the last four generations of Google’s flagship AI accelerator (TPU).

East 2024 Video Highlights

Prompt Engineering with Llama 3 with Amit Sangani
This session aims to provide hands-on, engaging content that gives developers a basic understanding of Llama 3 models, how to access and use them, understand the architecture, and build an AI chatbot using LangChain and Tools. The audience will also learn core concepts around Prompt Engineering and Fine-Tuning and programmatically implement them using Responsible AI principles. Lastly, the talk will be concluded by explaining how they can leverage this powerful tech, different use cases, and what the future looks like.

East 2024 Video Highlights

Deciphering Data Architectures with James Serra
Data fabric, data lakehouse, and data mesh have recently appeared as viable alternatives to the modern data warehouse. These new architectures have solid benefits, but they’re also surrounded by a lot of hyperbole and confusion. In this presentation, James Serra will give you a guided tour of each architecture to help you understand its pros and cons. He will also examine common data architecture concepts, including data warehouses and data lakes. You’ll learn what data lakehouses can help you achieve, and how to distinguish data mesh hype from reality. Best of all, you’ll be able to determine the most appropriate data architecture for your needs. The content is derived from my book Deciphering Data Architectures: Choosing Between a Modern Data Warehouse, Data Fabric, Data Lakehouse, and Data Mesh.

Why not Experience ODSC Live?

  • Don’t just see the top data scientists.  Meet and connect with them. Get inspired and motivated.
  • Participate in hands-on workshops and training sessions that deliver a proven better learning outcome.
  • Build your network and get ready for your next project or career move
  • Be part of tone of the most dynamic and educational data science conference anywhere.

ODSC West 2024 | October 29-31st

First 100 Passes Available Now
ODSC is the best community data science event on the planet. There are other events that cover special topics, or industries, etc., but ODSC is comprehensive and totally community-focused: it's the conference to engage, to build, to develop, and to learn from the whole data science community.
Kirk Borne @ ODSC East, 2019

ODSC Europe 2024 | September 5-6th

First 50 Passes Available Now
Learn more reasons to attend ODSC East 2024
Why Attend



Register Now
Open Data Science




Open Data Science
One Broadway
Cambridge, MA 02142

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Consent to display content from - Youtube
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google