Aditya Palnitkar

Aditya Palnitkar

Staff Software Engineer at Meta

Aditya is a staff engineer / TL at Meta. After his undergrad from BITS Pilani, he graduated with a MS in CS from Stanford, with a focus on using ML for performing graph analysis and predictions. In his decade of working in AI / ML, he has gained unique experience and insights working on state of the art recommendations models backing Facebook Reels and Facebook Watch, which serve 1B+ users every day. He is now tech-leading a team working on evaluating AI agents being built at Meta.

All Sessions by Aditya Palnitkar

May 14th 11/07/2026
2:00 pm - 2:30 pm

Virtual Only: Evals for Supercharging your AI Agents

<span class="etn-schedule-location"> <span class="firstfocus">AI Agents</span> <span class="secfocus">Beginner-Intermediate</span> </span>

Deploying LLM applications without robust testing and monitoring is a recipe for failure. In this talk, you'll discover how a world-class evaluation system can supercharge your AI agents by turning potential fragility into development velocity. Learn to build rigorous feedback loops that drive ROI—from creating high-quality, human-labeled datasets and leveraging LLMs as both judges and user simulators, to designing benchmarks that catch hallucinations and monitor failure modes. Join us to unlock strategies that align evaluation metrics with your business goals, ensuring your LLM applications not only perform reliably but continuously improve.

May 14th 11/07/2026
2:00 pm - 2:30 pm

Virtual Only: Evals for Supercharging your AI Agents

<span class="etn-schedule-location"> <span class="firstfocus">AI Agents</span> <span class="secfocus">Beginner-Intermediate</span> </span>

Deploying LLM applications without robust testing and monitoring is a recipe for failure. In this talk, you'll discover how a world-class evaluation system can supercharge your AI agents by turning potential fragility into development velocity. Learn to build rigorous feedback loops that drive ROI—from creating high-quality, human-labeled datasets and leveraging LLMs as both judges and user simulators, to designing benchmarks that catch hallucinations and monitor failure modes. Join us to unlock strategies that align evaluation metrics with your business goals, ensuring your LLM applications not only perform reliably but continuously improve.

Open Data Science

 

 

 

Open Data Science
One Broadway
Cambridge, MA 02142
info@odsc.com

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Youtube
Consent to display content from - Youtube
Vimeo
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google