Evolving Trends in Prompt Engineering for Large Language Models (LLMs) with Built-in Responsible AI Practices

Abstract: 

The advent of Large Language Models (LLMs) such as GPT, Llama, PaLM has revolutionized the AI space and has enabled organizations to reimagine the reinvent the technology and business ecosystem. These models are helping to create unique capabilities, be it enterprise search, topic identification, summarization, conversational bots, content generation and many more. Organizations are leveraging LLMs through various means such as out of box application, prompt engineering and model fine tuning. Though we are seeing early success, there are challenges and adopting LLMs for various business use cases is still an evolving space. In this talk we delve into the cutting-edge aspects of LLMs, focusing on four critical dimensions: Prompt Engineering, Evaluation, Model Optimization & Deployment, and Responsible AI.

Prompt Engineering involves developing and optimizing prompts to efficiently guide LLMs by exploring various prompting techniques like Chain-of-Thought, Chain-of-Prompts, Tree of Thought, ReACt to generate a reliable response.
The Evaluation dimension addresses the challenge of assessing LLM's performance. Comprehensive evaluation criteria and metrics, such as Perplexity, ROUGE, and human evaluation are covered to measure effectiveness across tasks and domains.

The Model Optimization and Deployment dimension covers the SOTA parameter efficient fine-tuning (PEFT) methods like LoRA/QLoRA that is used to train and deploy LLMs at scale by ensuring low computation usage and cost.
Responsible AI dimension emphasizes the ethical considerations in LLMs deployment thereby creating trust among the consumers of AI applications. Strategies for ensuring security, privacy, interpretability, and fairness are explored with techniques for protecting sensitive information, enhancing trust, and detecting bias.

In summary, this session will comprehensively cover current challenges and solutions across various dimensions for adoption of LLMs at enterprise scale. It will also provide researchers, practitioners, and policymakers with valuable insights for adopting and deploying LLMs effectively and responsibly. Unlocking the vast potential of LLMs in NLP will trigger innovative ideas and is expected to disrupt and radically transform the technology and business landscape in the coming days.

Bio: 

Jayachandran Ramachandran is the Senior Vice President and Head of Artificial Intelligence Labs at Course5 Intelligence. He is responsible for Applied AI research, Innovation and IP development. He is a highly experienced Analytics and Artificial Intelligence (AI) thought leader, design thinker, inventor with extensive expertise across a wide variety of industry verticals like Retail, CPG, Technology, Telecom, Financial Services, Pharma, Manufacturing, Energy, Utilities etc.

Open Data Science

 

 

 

Open Data Science
One Broadway
Cambridge, MA 02142
info@odsc.com

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Youtube
Consent to display content from - Youtube
Vimeo
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google