ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
ipex-llm/python/llm/example/CPU
History
dingbaorong 5a2ce421af add cpu and gpu examples of flan-t5 (#9171) 
* add cpu and gpu examples of flan-t5

* address yuwen's comments
* Add explanation  why we add modules to not convert
* Refine prompt and add a translation example
* Add a empty line at the end of files

* add examples of flan-t5 using optimize_mdoel api

* address bin's comments

* address binbin's comments

* add flan-t5 in readme
2023-10-24 15:24:01 +08:00
..
HF-Transformers-AutoModels add cpu and gpu examples of flan-t5 (#9171) 2023-10-24 15:24:01 +08:00
LangChain LLM: update example layout (#9046) 2023-10-09 15:36:39 +08:00
Native-Models LLM: update example layout (#9046) 2023-10-09 15:36:39 +08:00
PyTorch-Models add cpu and gpu examples of flan-t5 (#9171) 2023-10-24 15:24:01 +08:00
README.md LLM: update example layout (#9046) 2023-10-09 15:36:39 +08:00

README.md

BigDL-LLM Examples on Intel CPU

This folder contains examples of running BigDL-LLM on Intel CPU:

  • HF-Transformers-AutoModels: running any Hugging Face Transformers model on BigDL-LLM (using the standard AutoModel APIs)
  • PyTorch-Models: running any PyTorch model on BigDL-LLM (with "one-line code change")
  • Native-Models: converting & running LLM in llama/chatglm/bloom/gptneox/starcoder model family using native (cpp) implementation
  • LangChain: running LangChain applications on BigDL-LLM

System Support

Hardware:

  • Intel® Core™ processors
  • Intel® Xeon® processors

Operating System:

  • Ubuntu 20.04 or later
  • CentOS 7 or later
  • Windows 10/11, with or without WSL