TensorExpress: In-network communication scheduling for distributed deep learning

  • Minkoo Kang
  • , Gyeongsik Yang
  • , Yeonho Yoo
  • , Chuck Yoo

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

15 Scopus citations

Abstract

TensorExpress provides in-network communication scheduling for distributed deep learning (DDL). In cloud-based DDL, parameter communication over a network is a key bottleneck. Previous studies proposed tensor packet reordering approaches to reduce network blocking time. However, network contention still exists in DDL. TensorExpress mitigates network contention and reduces overall training time. It schedules tensor packets in-network using P4, a switch programming language. TensorExpress improves latency and network blocking time up to 2.5 and 2.44 times, respectively.

Original languageEnglish
Title of host publicationProceedings - 2020 IEEE 13th International Conference on Cloud Computing, CLOUD 2020
PublisherIEEE Computer Society
Pages25-27
Number of pages3
ISBN (Electronic)9781728187808
DOIs
StatePublished - Oct 2020
Event13th IEEE International Conference on Cloud Computing, CLOUD 2020 - Virtual, Beijing, China
Duration: 18 Oct 202024 Oct 2020

Publication series

NameIEEE International Conference on Cloud Computing, CLOUD
Volume2020-October
ISSN (Print)2159-6182
ISSN (Electronic)2159-6190

Conference

Conference13th IEEE International Conference on Cloud Computing, CLOUD 2020
Country/TerritoryChina
CityVirtual, Beijing
Period18/10/2024/10/20

Keywords

  • Communication scheduling
  • Distributed deep learning
  • In-network delay
  • P4
  • Parameter server architecture

Fingerprint

Dive into the research topics of 'TensorExpress: In-network communication scheduling for distributed deep learning'. Together they form a unique fingerprint.

Cite this