Quantized Sparse Weight Decomposition for Neural Network Compression von Kuzmin, Andrey, van Baalen, Mart, Nagel, Markus, Behboodi, Arash

Volltext bestellen

Mixture of Cache-Conditional Experts for Efficient Mobile Device Inference von Skliar, Andrii, van Rozendaal, Ties, Lepert, Romain, Boinovski, Todor, van Baalen, Mart, Nagel, Markus, Whatmough, Paul, Bejnordi, Babak Ehteshami

Volltext bestellen

The LLM Surgeon von van der Ouderaa, Tycho F. A, Nagel, Markus, van Baalen, Mart, Asano, Yuki M, Blankevoort, Tijmen

Volltext bestellen

Efficient LLM Inference using Dynamic Input Pruning and Cache-Aware Masking von Federici, Marco, Belli, Davide, van Baalen, Mart, Jalalirad, Amir, Skliar, Andrii, Major, Bence, Nagel, Markus, Whatmough, Paul

Volltext bestellen

QBitOpt: Fast and Accurate Bitwidth Reallocation during Training von Peters, Jorn, Fournarakis, Marios, Nagel, Markus, van Baalen, Mart, Blankevoort, Tijmen

Volltext bestellen

Pruning vs Quantization: Which is Better? von Kuzmin, Andrey, Nagel, Markus, van Baalen, Mart, Behboodi, Arash, Blankevoort, Tijmen

Volltext bestellen

GPTVQ: The Blessing of Dimensionality for LLM Quantization von van Baalen, Mart, Kuzmin, Andrey, Nagel, Markus, Couperus, Peter, Bastoul, Cedric, Mahurin, Eric, Blankevoort, Tijmen, Whatmough, Paul

Volltext bestellen

A Practical Mixed Precision Algorithm for Post-Training Quantization von Pandey, Nilesh Prasad, Nagel, Markus, van Baalen, Mart, Huang, Yin, Patel, Chirag, Blankevoort, Tijmen

Volltext bestellen

Rapid Switching and Multi-Adapter Fusion via Sparse High Rank Adapters von Bhardwaj, Kartikeya, Pandey, Nilesh Prasad, Priyadarshi, Sweta, Ganapathy, Viswanath, Esteves, Rafael, Kadambi, Shreya, Borse, Shubhankar, Whatmough, Paul, Garrepalli, Risheek, Van Baalen, Mart, Teague, Harris, Nagel, Markus

Volltext bestellen

Sparse High Rank Adapters von Bhardwaj, Kartikeya, Pandey, Nilesh Prasad, Priyadarshi, Sweta, Ganapathy, Viswanath, Esteves, Rafael, Kadambi, Shreya, Borse, Shubhankar, Whatmough, Paul, Garrepalli, Risheek, Van Baalen, Mart, Teague, Harris, Nagel, Markus

Volltext bestellen

FP8 Quantization: The Power of the Exponent von Kuzmin, Andrey, Van Baalen, Mart, Ren, Yuwei, Nagel, Markus, Peters, Jorn, Blankevoort, Tijmen

Volltext bestellen

Cyclical Pruning for Sparse Neural Networks von Srinivas, Suraj, Kuzmin, Andrey, Nagel, Markus, van Baalen, Mart, Skliar, Andrii, Blankevoort, Tijmen

Volltext bestellen

FP8 versus INT8 for efficient deep learning inference von van Baalen, Mart, Kuzmin, Andrey, Nair, Suparna S, Ren, Yuwei, Mahurin, Eric, Patel, Chirag, Subramanian, Sundar, Lee, Sanghyuk, Nagel, Markus, Soriaga, Joseph, Blankevoort, Tijmen

Volltext bestellen

A White Paper on Neural Network Quantization von Nagel, Markus, Fournarakis, Marios, Amjad, Rana Ali, Bondarenko, Yelysei, van Baalen, Mart, Blankevoort, Tijmen

Volltext bestellen

Data-Free Quantization Through Weight Equalization and Bias Correction von Nagel, Markus, van Baalen, Mart, Blankevoort, Tijmen, Welling, Max

Volltext bestellen

The LLM Surgeon von Tycho F A van der Ouderaa, Nagel, Markus, Mart van Baalen, Asano, Yuki M, Blankevoort, Tijmen

Volltext

Bayesian Bits: Unifying Quantization and Pruning von van Baalen, Mart, Louizos, Christos, Nagel, Markus, Amjad, Rana Ali, Wang, Ying, Blankevoort, Tijmen, Welling, Max

Volltext bestellen

Up or Down? Adaptive Rounding for Post-Training Quantization von Nagel, Markus, Amjad, Rana Ali, van Baalen, Mart, Louizos, Christos, Blankevoort, Tijmen

Volltext bestellen

Quantized Sparse Weight Decomposition for Neural Network Compression von Kuzmin, Andrey, Mart van Baalen, Nagel, Markus, Behboodi, Arash

Volltext

Mixture of Cache-Conditional Experts for Efficient Mobile Device Inference von Skliar, Andrii, Ties van Rozendaal, Lepert, Romain, Boinovski, Todor, Mart van Baalen, Nagel, Markus, Whatmough, Paul, Babak Ehteshami Bejnordi

Volltext