Artificial neural networks activation function HDL coder

The sigmoid and hyperbolic tangent functions are usually used as the activation functions in Artificial Neural Networks (ANNs). The exponential nature of these functions make them difficult for hardware implementation. Hence, several different methods for approximating them in hardware are proposed....

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Namin, A.H., Leboeuf, K., Huapeng Wu, Ahmadi, M.
Format: Tagungsbericht
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
Beschreibung
Zusammenfassung:The sigmoid and hyperbolic tangent functions are usually used as the activation functions in Artificial Neural Networks (ANNs). The exponential nature of these functions make them difficult for hardware implementation. Hence, several different methods for approximating them in hardware are proposed. In this work, we present a MATLAB toolbox called the ldquoSigTan HDL Coderrdquo, that generates synthesizable HDL Code which approximates these functions in hardware according to the specific user requirements. The HDL code is platform independent and can be used for FPGA as well as ASIC implementations. Input parameters to the system are the approximation error, input range, and the approximation method. Three different user-selectable methods for approximating the functions are programmed in the toolbox. All implemented approximation methods avoid the use of multipliers for their implementation, as multipliers are expensive hardware components in terms of area and speed.
ISSN:2154-0357
2154-0373
DOI:10.1109/EIT.2009.5189648