yuimo / autoawq Goto Github PK
View Code? Open in Web Editor NEWThis project forked from casper-hansen/autoawq
LLM量化工具//AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
Home Page: https://casper-hansen.github.io/AutoAWQ/
License: MIT License