ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/CPU
History
Yining Wang 4a19f50d16 phi-1_5 CPU and GPU examples (#9173) 
* eee

* add examples on CPU and GPU

* fix

* fix

* optimize model examples

* have updated

* Warmup and configs added

* Update two tables
2023-10-24 15:08:04 +08:00
..
HF-Transformers-AutoModels phi-1_5 CPU and GPU examples (#9173) 2023-10-24 15:08:04 +08:00
LangChain LLM: update example layout (#9046) 2023-10-09 15:36:39 +08:00
Native-Models LLM: update example layout (#9046) 2023-10-09 15:36:39 +08:00
PyTorch-Models phi-1_5 CPU and GPU examples (#9173) 2023-10-24 15:08:04 +08:00
README.md LLM: update example layout (#9046) 2023-10-09 15:36:39 +08:00

README.md

BigDL-LLM Examples on Intel CPU

This folder contains examples of running BigDL-LLM on Intel CPU:

  • HF-Transformers-AutoModels: running any Hugging Face Transformers model on BigDL-LLM (using the standard AutoModel APIs)
  • PyTorch-Models: running any PyTorch model on BigDL-LLM (with "one-line code change")
  • Native-Models: converting & running LLM in llama/chatglm/bloom/gptneox/starcoder model family using native (cpp) implementation
  • LangChain: running LangChain applications on BigDL-LLM

System Support

Hardware:

  • Intel® Core™ processors
  • Intel® Xeon® processors

Operating System:

  • Ubuntu 20.04 or later
  • CentOS 7 or later
  • Windows 10/11, with or without WSL