ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/CPU
History
Guoqiong Song aa319de5e8 Add streaming-llm using llama2 on CPU (#9265) 
Enable streaming-llm to let model take infinite inputs, tested on desktop and SPR10
2023-10-27 01:30:39 -07:00
..
applications/streaming-llm Add streaming-llm using llama2 on CPU (#9265) 2023-10-27 01:30:39 -07:00
HF-Transformers-AutoModels Add qwen vl CPU example (#9221) 2023-10-25 13:22:12 +08:00
LangChain LLM: update example layout (#9046) 2023-10-09 15:36:39 +08:00
Native-Models LLM: update example layout (#9046) 2023-10-09 15:36:39 +08:00
PyTorch-Models Add qwen vl CPU example (#9221) 2023-10-25 13:22:12 +08:00
README.md LLM: update example layout (#9046) 2023-10-09 15:36:39 +08:00

README.md

BigDL-LLM Examples on Intel CPU

This folder contains examples of running BigDL-LLM on Intel CPU:

  • HF-Transformers-AutoModels: running any Hugging Face Transformers model on BigDL-LLM (using the standard AutoModel APIs)
  • PyTorch-Models: running any PyTorch model on BigDL-LLM (with "one-line code change")
  • Native-Models: converting & running LLM in llama/chatglm/bloom/gptneox/starcoder model family using native (cpp) implementation
  • LangChain: running LangChain applications on BigDL-LLM

System Support

Hardware:

  • Intel® Core™ processors
  • Intel® Xeon® processors

Operating System:

  • Ubuntu 20.04 or later
  • CentOS 7 or later
  • Windows 10/11, with or without WSL