Post-Training Statistical Calibration for Higher Activation Sparsity

We present Statistical Calibrated Activation Pruning (SCAP), a post-training activation pruning framework that (1) generalizes sparsification by input activations of Fully-Connected layers for generic and flexible application across Transformers, and (2) features a simple Mode-Centering technique to...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Chua, Vui Seng, Pan, Yujie, Jain, Nilesh
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Artificial Intelligence Computer Science - Learning
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!