GPU-enabled back-propagation artificial neural network for digit recognition in parallel

Ricardo Brito, Simon Fong, Kyungeun Cho, Wei Song, Raymond Wong, Sabah Mohammed, Jinan Fiaidhi

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

In this paper, we show that the GPU (graphics processing unit) can be used not only for processing graphics, but also for high speed computing. We provide a comparison between the times taken on the CPU and GPU to perform the training and testing of a back-propagation artificial neural network. We implemented two neural networks for recognizing handwritten digits; one consists of serial code executed on the CPU, while the other is a GPU-based version of the same system which executes in parallel. As an experiment for performance evaluation, a system for neural network training on the GPU is developed to reduce training time. The programming environment that the system is based on is CUDA which stands for compute unified device architecture, which allows a programmer to write code that will run on an NVIDIA GPU card. Our results over an experiment of digital image recognition using neural network confirm the speed-up advantages by tapping on the resources of GPU. Our proposed model has an advantage of simplicity, while it shows on par performance with the state-of-the-arts algorithms.

Original languageEnglish
Pages (from-to)3868-3886
Number of pages19
JournalJournal of Supercomputing
Volume72
Issue number10
DOIs
StatePublished - 1 Oct 2016

Keywords

  • Artificial neural networks
  • CUDA
  • NVIDIA
  • Parallel execution

Fingerprint

Dive into the research topics of 'GPU-enabled back-propagation artificial neural network for digit recognition in parallel'. Together they form a unique fingerprint.

Cite this