はてなブックマーク

Quantization Error Propagation (QEP): A post-training quantization method that corrects quantization errors by propagating them to subsequent layers, improving the accuracy of quantized LLMs. See Arai & Ichikawa, NeurIPS 2025 for details. The original reference implementation is available at FujitsuResearch/qep. vLLM Plugin Integration: Serve OneComp-quantized models with vLLM via built-in plugins