Data Science Software Acceleration at the Edge

Abstract: 

How can you accelerate Data Science at the Edge? We are all familiar with being able to accelerate model learning and training through the use of GPU Acceleration, built-in processors and embedded software. With limited CPU, memory and storage at the edge, these traditional approaches to acceleration can be a challenge. And it’s not only at the ‘model and application level’ where data science can be accelerated. We can also accelerate data science by improving our infrastructure management and deployment methods (e.g. OS image generation and management).

Some scientists have turned to pruning and quantizing their larger models which can make the models smaller and easier to deploy to the Edge. Although pruning and quantization can produce more performant models, the models themselves can be less accurate. And model accuracy is something that many companies cannot sacrifice. What options are left?

In this session, we will first arrive at a definition of Edge and its different environments. This will enable us to discuss what hardware (compute) is available for data science (model training and execution) usage in these environments. Lastly, we will examine interesting data science acceleration alternatives in the areas of data augmentation and data curation strategies, containerized models and applications.

Join me, for a gentle introduction, as I discuss how we can accelerate Data Science at the Edge.

Bio: 

Audrey is a Sr. Principal Software Engineer in the Red Hat Cloud Services - Red Hat OpenShift Data Science team focusing on helping customers with managed services, AI/ML workloads and next-generation platforms. She holds a degree in Computer Information Systems and has been working in the IT Industry for over 20 years in full stack development to data science roles. Audrey is passionate about Data Science and in particular the current opportunities with AIML at the Edge and Open Source technologies.

Open Data Science

 

 

 

Open Data Science
One Broadway
Cambridge, MA 02142
info@odsc.com

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Youtube
Consent to display content from Youtube
Vimeo
Consent to display content from Vimeo
Google Maps
Consent to display content from Google