Effects of the Nonlinearity in Activation Functions on the Performance of Deep Learning Models

The nonlinearity of activation functions used in deep learning models are crucial for the success of predictive models. There are several commonly used simple nonlinear functions, including Rectified Linear Unit (ReLU) and Leaky-ReLU (L-ReLU). In practice, these functions remarkably enhance the mode...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2020-10
Hauptverfasser:	Kulathunga, Nalinda, Ranasinghe, Nishath Rajiv, Vrinceanu, Daniel, Kinsman, Zackary, Huang, Lei, Wang, Yunjiao
Format:	Artikel
Sprache:	eng
Schlagworte:	Activation Deep learning Image classification Machine learning Model accuracy Nonlinearity Prediction models
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!