ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/CPU/README.md
Zheng, Yi a4a1dec064 Add a cpu example of HuggingFace Transformers Agent (use vicuna-7b-v1.5) (#9284) 
* Add examples of HF Agent

* Modify folder structure and add link of demo.jpg

* Fixes of readme

* Merge applications and Applications
2023-10-27 17:14:12 +08:00

859 B
Raw Blame History

BigDL-LLM Examples on Intel CPU

This folder contains examples of running BigDL-LLM on Intel CPU:

  • HF-Transformers-AutoModels: running any Hugging Face Transformers model on BigDL-LLM (using the standard AutoModel APIs)
  • PyTorch-Models: running any PyTorch model on BigDL-LLM (with "one-line code change")
  • Native-Models: converting & running LLM in llama/chatglm/bloom/gptneox/starcoder model family using native (cpp) implementation
  • LangChain: running LangChain applications on BigDL-LLM
  • Applications: running Transformers applications on BigDl-LLM

System Support

Hardware:

  • Intel® Core™ processors
  • Intel® Xeon® processors

Operating System:

  • Ubuntu 20.04 or later
  • CentOS 7 or later
  • Windows 10/11, with or without WSL