1. Science
  2. Publications
  3. Information Processing Systems
  4. 1(152)'2018
  5. Analysis of deep neural network models based on restricted Boltzmann machines

Analysis of deep neural network models based on restricted Boltzmann machines

M. Pryshliak, S. Subbotin, A. Oliinyk
Annotations languages:


Description: A number of modern approaches exist to perform classification task – Bayes classification, decision trees, artificial neural networks and neuro-fuzzy models. Deep neural networks are the most promising out of them to study, as they can outperform other methods in a lower resulting model complexity, ability to learn from unlabeled data and modeling non-linear distributions within certain limits. This paper aims to perform analysis of deep neural network models based on restricted Boltzmann machines and their learning methods and proposes classification and comparison of their features. It highlights the advantages and disadvantages of deep neural network architectures as well. In the experiment, restricted and deep Boltzmann machine models were studied, as well as deep belief networks. Their performance was compared on a common classification task with a numeric data arrays – medical diagnosis of breast cancer. Deeplearning4J library was used for building and learning neural networks. Experiment results made it possible to obtain computer memory usage and neural network performance values of studied learning methods for different deep models. We emphasize recommendations on choosing the correct deep neural network architecture for solving classification problems. The conducted experiments showed that among the considered network models the most rapidly trained is the restricted Boltzmann machine, the most accurate is the deep belief network. The restricted Boltzmann machine can be effectively used in those cases where the speed of training is important, but not accuracy. Among the examined deep models, a belief network is most effective both in terms of the training speed and of assessing the probability of right decision making.


Keywords: deep neural networks, machine learning, Boltzmann machine, classification

Reference:
Prishliak, M.Iu., Subbotin, S.A. and Oleinik, A.A. (2018), “Analiz glubokikh modelei neironnykh setei na baze ogranichennykh mashin Boltsmana” [Analysis of deep neural network models based on restricted Boltzmann machines], Information Processing Systems, Vol. 1(152), pp. 108-117. https://doi.org/10.30748/soi.2018.152.16.