Date of Award
2018
Document Type
Thesis
Publication Status
Version of Record
Submission Date
October 2026
Thesis/Dissertation Advisor [Chair]
Khoshgoftaar, Taghi M.
Abstract
Deep Learning is an increasingly important subdomain of arti cial intelligence. Deep Learning architectures, arti cial neural networks characterized by having both a large breadth of neurons and a large depth of layers, bene ts from training on Big Data. The size and complexity of the model combined with the size of the training data makes the training procedure very computationally and temporally expensive. Accelerating the training procedure of Deep Learning using cluster computers faces many challenges ranging from distributed optimizers to the large communication overhead speci c to a system with o the shelf networking components. In this thesis, we present a novel synchronous data parallel distributed Deep Learning implementation on HPCC Systems, a cluster computer system. We discuss research that has been conducted on the distribution and parallelization of Deep Learning, as well as the concerns relating to cluster environments. Additionally, we provide case studies that evaluate and validate our implementation.
Extent
83 p.
Recommended Citation
Kennedy, Robert Kwan Lee, "Parallel Distributed Deep Learning on Cluster Computers" (2018). Electronic Theses and Dissertations 2010 - 2019. 1989.
https://digitalcommons.fau.edu/etd_general_6/1989
Identifier
FA00013080
Comments
Includes bibliography.|Thesis (M.S.)--Florida Atlantic University, 2018.|FAU Electronic Theses and Dissertations Collection|Includes bibliography.