4 commits

Author	SHA1	Message	Date
Heyang Sun	9f02f96160	[LLM] support for Yi AWQ model (#9648)	2023-12-11 14:07:34 +08:00
Heyang Sun	3811cf43c9	[LLM] update AWQ documents (#9623) ... * [LLM] update AWQ and verified models' documents * refine * refine links * refine	2023-12-07 16:02:20 +08:00
binbin Deng	6bec0faea5	LLM: support Mistral AWQ models (#9520)	2023-11-24 16:20:22 +08:00
Yina Chen	d5263e6681	Add awq load support (#9453) ... * Support directly loading GPTQ models from huggingface * fix style * fix tests * change example structure * address comments * fix style * init * address comments * add examples * fix style * fix style * fix style * fix style * update * remove * meet comments * fix style --------- Co-authored-by: Yang Wang <yang3.wang@intel.com>	2023-11-16 14:06:25 +08:00