ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python
History
Guancheng Fu 5857a38321 [vLLM] Add option to adjust KV_CACHE_ALLOC_BLOCK_LENGTH (#9782) 
* add option kv_cache_block

* change var name
2023-12-28 14:41:47 +08:00
..
llm [vLLM] Add option to adjust KV_CACHE_ALLOC_BLOCK_LENGTH (#9782) 2023-12-28 14:41:47 +08:00