Abstract: A biological inspired algorithm from human brain known as deep neural network (DNN) containing of multiple hidden layers often occurs vanishing gradient problem due to the saturation ...