ROCK-CNN: Distributed Deep Learning Computations in a Resource-Constrained Cluster

The paper is dedicated to distributed convolutional neural networks on a resource constrained devices cluster. The authors focus on requirements that meet the users' needs. Based on this, architecture of the system is proposed. Two use cases of CNN computations on a ROCK-CNN cluster are mentioned, and algorithms for organizing distributed convolutional neural networks are described. Experiments to validate proposed architecture and algorithms for distributed deep learning computations are conducted as well.