ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/CPU/Applications/streaming-llm/streaming_llm
History
Guoqiong Song f4a2e32106 Stream llm example for both GPU and CPU (#9390)
2024-02-27 15:54:47 -08:00
..
__init__.py Add a cpu example of HuggingFace Transformers Agent (use vicuna-7b-v1.5) (#9284) 2023-10-27 17:14:12 +08:00
enable_streaming_llm.py Stream llm example for both GPU and CPU (#9390) 2024-02-27 15:54:47 -08:00
kv_cache.py Add a cpu example of HuggingFace Transformers Agent (use vicuna-7b-v1.5) (#9284) 2023-10-27 17:14:12 +08:00
modify_falcon.py Add a cpu example of HuggingFace Transformers Agent (use vicuna-7b-v1.5) (#9284) 2023-10-27 17:14:12 +08:00
modify_gpt_neox.py Add a cpu example of HuggingFace Transformers Agent (use vicuna-7b-v1.5) (#9284) 2023-10-27 17:14:12 +08:00
modify_llama.py Stream llm example for both GPU and CPU (#9390) 2024-02-27 15:54:47 -08:00
utils.py Add a cpu example of HuggingFace Transformers Agent (use vicuna-7b-v1.5) (#9284) 2023-10-27 17:14:12 +08:00