MLOps: ML Engineering Best Practices from the Trenches
MLOps: ML Engineering Best Practices from the Trenches


Artificial Intelligence is already helping many businesses become more competitive, but how do you move machine learning (ML) models efficiently from research to production? We believe it is imperative to plan for production from day one—both by using a discipline process and by choosing the right tools. Fortunately, we don’t have to build from scratch, as Machine Learning Engineers we can adapt many of the best practices from the DevOps playbook and apply them to the ML workflow.

In this session, we explain some of the ML development best practices we have developed from working in the trenches. The core of our approach comes down to a philosophy of engineering discipline around “being the Navy, and not pirates.” Wherever possible, we explain how to reduce the incidental complexity in ML development by using appropriate tooling and process. We deep dive into certain best practices like using Docker on day one, continuous integration for ML, experiment tracking using MLFlow, and experimenting at scale in the cloud.

Session Outline
* Background (10 mins)
* Key Lessons
** Use Docker on Day One (25 min)
** Use a Structured ML Software Workflow (25 min)
** Downstream Containerization Benefits (15 min)
* Conclusion / Q&A (15 min)

Background Knowledge
Python, Git


Alexander Ng is a Senior Data Engineer at Manifold, an artificial intelligence engineering services firm with offices in Boston and Silicon Valley. Prior to Manifold, Alex served as both a Sales Engineering Tech Lead and a DevOps Tech Lead for Kyruus, a startup that built SaaS products for enterprise healthcare organizations. Alex got his start as a Software Systems Engineer at the MITRE Corporation and the Naval Undersea Warfare Center in Newport, RI. His recent projects at the intersection of systems and machine learning continue to combine a deep understanding of the entire development lifecycle with cutting-edge tools and techniques. Alex earned his Bachelor of Science degree in Electrical Engineering from Boston University, and is an AWS Certified Solutions Architect.

Open Data Science




Open Data Science
One Broadway
Cambridge, MA 02142

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Consent to display content from - Youtube
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google