High-Performance Input Pipelines for Scalable Deep Learning
High-Performance Input Pipelines for Scalable Deep Learning


Learn how to keep your GPUs fed with data as you train the next-generation of deep learning architectures. As GPU technology continues to advance, the demand for faster data continues to grow. In deep learning, input pipelines are responsible for a complex chain of actions that ultimately feed data into GPU memory: defining how files are read from storage, deserializing them into data structures, pre-processing on a CPU, and copying to the GPU. These pipelines bring together complex hardware systems—including cluster networks, peripheral interconnects, modern CPUs, and storage devices—along with sophisticated software systems to drive the data movement and transformation.

In this talk, we present a new benchmark suite for evaluating and tuning input pipelines. We will examine results with TensorFlow’s DataSets API on a DGX-1 with V100 and provide guidance on key tuning parameters and diagnostic techniques for improving performance.


Ramnath is Senior Manager, Product Marketing for AI and Deep Learning at Pure. Previously, he worked as a Marketing Manager at Mellanox Technologies, leading the market development activities for AI, BigData & Cloud. Before that, he was the RDMA Solutions Evangelist and led Cloud & Big Data strategy at Emulex. Prior to joining Emulex, he worked in two of the most prestigious research labs in Europe - Brain Mind Institute at EPFL, Switzerland and Barcelona Supercomputing Center in Spain. He has 15+ publications in leading conference and journals

Privacy Settings
We use cookies to enhance your experience while using our website. If you are using our Services via a browser you can restrict, block or remove cookies through your web browser settings. We also use content and scripts from third parties that may use tracking technologies. You can selectively provide your consent below to allow such third party embeds. For complete information about the cookies we use, data we collect and how we process them, please check our Privacy Policy
Consent to display content from - Youtube
Consent to display content from - Vimeo
Google Maps
Consent to display content from - Google