Interleaved Data Processing Scheme for Optimizing Tensorflow Framework

Jinseo Choi, Minseon Cho, Donghyun Kang

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Nowadays, technologies based on machine learning (ML) are becoming a popular solution for building recommendation services on consumer electronics (CE) devices. Therefore, in this paper, we introduce i.data (interleaved data) processing scheme to more efficiently enable ML models on CE devices. The key idea of i.data is to interleave the training and inference steps in a parallel way so as to improve the GPU utilization and overall performance. We also compared i.data with Numpy and tf.data that are widely used to build ML models in various environments including CE and the internet of things (IoT). Our experimental results clearly show that i.data improves the performance compared with the traditional data processing approaches.

Original languageEnglish
Title of host publication2021 IEEE 11th International Conference on Consumer Electronics, ICCE-Berlin 2021
PublisherIEEE Computer Society
ISBN (Electronic)9781665428316
DOIs
StatePublished - 2021
Event11th IEEE International Conference on Consumer Electronics, ICCE-Berlin 2021 - Berlin, Germany
Duration: 15 Nov 202118 Nov 2021

Publication series

NameIEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin
Volume2021-November
ISSN (Print)2166-6814
ISSN (Electronic)2166-6822

Conference

Conference11th IEEE International Conference on Consumer Electronics, ICCE-Berlin 2021
Country/TerritoryGermany
CityBerlin
Period15/11/2118/11/21

Keywords

  • dataflow
  • machine learning
  • multiple thread
  • tensorflow
  • tf.data

Fingerprint

Dive into the research topics of 'Interleaved Data Processing Scheme for Optimizing Tensorflow Framework'. Together they form a unique fingerprint.

Cite this