ipex-llm/python/llm
hxsz1997 62b2d8af6b
Add lookahead in all-in-one (#11142)
* add lookahead in allinone

* delete save to csv in run_transformer_int4_gpu

* change lookup to lookahead

* fix the error of add model.peak_memory

* Set transformer_int4_gpu as the default option

* add comment of transformer_int4_fp16_lookahead_gpu
2024-05-28 15:39:58 +08:00
..
dev Add lookahead in all-in-one (#11142) 2024-05-28 15:39:58 +08:00
example Refine Pipeline-Parallel-Fastapi example README (#11155) 2024-05-28 15:18:21 +08:00
portable-zip Fix baichuan-13b issue on portable zip under transformers 4.36 (#10746) 2024-04-12 16:27:01 -07:00
scripts add ipex-llm-init.bat for Windows (#11082) 2024-05-24 14:26:25 +08:00
src/ipex_llm fix first token sdp with batch (#11153) 2024-05-28 15:03:06 +08:00
test Add Windows GPU unit test (#11050) 2024-05-28 13:29:47 +08:00
.gitignore [LLM] add chatglm pybinding binary file release (#8677) 2023-08-04 11:45:27 +08:00
setup.py Divide core-xe packages (#11131) 2024-05-28 12:00:18 +08:00
version.txt Update setup.py and add new actions and add compatible mode (#25) 2024-03-22 15:44:59 +08:00