BengaliBERT-Quant: Ultra-Low Bitrate Quantization for Bengali Transformer Models on Edge Devices
ACM Transactions on Asian and Low-Resource Language Information Processing (TALLIP 2025)
We introduce a 3-bit activation and weight quantization framework for low-resource Bengali transformer encoders. Our approach retains 97.4% F1-score on sentiment and named entity recognition while reducing memory footprint by 78%, enabling on-device inference on affordable Android micro-architectures.
