Deep Belief Network with Fuzzy Parameters and Its Membership Function Sensitivity Analysis
Year of publication
2025
Authors
Shukla, Amit K.; Muhuri, Pranab K.
Abstract
Over the last few years, deep belief networks (DBNs) have been extensively utilized for efficient and reliable performance in several complex systems. One critical factor contributing to the enhanced learning of the DBN layers is the handling of network parameters, such as weights and biases. The efficient training of these parameters significantly influences the overall enhanced performance of the DBN. However, the initialization of these parameters is often random, and the data samples are normally corrupted by unwanted noise. This causes the uncertainty to arise among weights and biases of the DBNs, which ultimately hinders the performance of the network. To address this challenge, we propose a novel DBN model with weights and biases represented using fuzzy sets. The approach systematically handles inherent uncertainties in parameters resulting in a more robust and reliable training process. We show the working of the proposed algorithm considering four widely used benchmark datasets such as: MNSIT, n-MNIST (MNIST with additive white Gaussian noise (AWGN) and MNIST with motion blur) and CIFAR-10. The experimental results show superiority of the proposed approach as compared to classical DBN in terms of robustness and enhanced performance. Moreover, it has the capability to produce equivalent results with a smaller number of nodes in the hidden layer; thus, reducing the computational complexity of the network architecture. Additionally, we also study the sensitivity analysis for stability and consistency by considering different membership functions to model the uncertain weights and biases. Further, we establish the statistical significance of the obtained results by conducting both one-way and Kruskal-Wallis analyses of variance tests.
Show moreOrganizations and authors
University of Vaasa
Shukla Amit Kumar
Publication type
Publication format
Article
Parent publication type
Journal
Article type
Original article
Audience
ScientificPeer-reviewed
Peer-ReviewedMINEDU's publication type classification code
A1 Journal article (refereed), original researchPublication channel information
Journal
Publisher
Volume
614
Article number
128716
ISSN
Publication forum
Publication forum level
2
Open access
Open access in the publisher’s service
Yes
Open access of publication channel
Partially open publication channel
Self-archived
Yes
Other information
Fields of science
Statistics and probability; Computer and information sciences
Keywords
[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
Publication country
Netherlands
Internationality of the publisher
International
Language
English
International co-publication
Yes
Co-publication with a company
No
DOI
10.1016/j.neucom.2024.128716
The publication is included in the Ministry of Education and Culture’s Publication data collection
Yes