ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
2263 commits 1 branch 0 tags 37 MiB
Commit graph

3 commits

Author SHA1 Message Date
Xiangyu Tian
f445217d02 LLM: Update IPEX to 2.2.0+cpu and Refactor for _ipex_optimize (#10189) 
Update IPEX to 2.2.0+cpu and refactor for _ipex_optimize.
 2024-02-22 16:01:11 +08:00
Wang, Jian4
fb53b994f8 LLM : Add llama ipex optimized (#10046) 
* init ipex

* remove padding
 2024-01-31 10:38:46 +08:00
Heyang Sun
b1ff28ceb6 LLama2 CPU example of speculative decoding (#9962) 
* LLama2 example of speculative decoding

* add docs

* Update speculative.py

* Update README.md

* Update README.md

* Update speculative.py

* remove autocast
 2024-01-31 09:45:20 +08:00