ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Update README.md (#8433)

Browse source
This commit is contained in:
Jason Dai 2023-07-03 10:24:54 +08:00 committed by GitHub
parent 449aea7ffc
commit f116833e42
1 changed files with 12 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

12
README.md
View file

@ -7,6 +7,18 @@ _**Fast, Distributed, Secure AI for Big Data**_
</div> </div>
--- ---
## Latest News
- **Try the latest [`bigdl-llm`](python/llm) for running LLM (language language model) on your Intel laptop using INT4 with very low latency!** *(It is built on top of the excellent work of [llama.cpp](https://github.com/ggerganov/llama.cpp), [gptq](https://github.com/IST-DASLab/gptq), [bitsandbytes](https://github.com/TimDettmers/bitsandbytes), etc.)*
<p align="center">
<img src="https://github.com/bigdl-project/bigdl-project.github.io/blob/master/assets/llm-7b.gif" width='33%' /> <img src="https://github.com/bigdl-project/bigdl-project.github.io/blob/master/assets/llm-13b.gif" width='33%' /> <img src="https://github.com/bigdl-project/bigdl-project.github.io/blob/master/assets/llm-15b5.gif" width='33%' />
<img src="https://github.com/bigdl-project/bigdl-project.github.io/blob/master/assets/llm-models.png" width='85%'/>
</p>
---
## Overview
BigDL seamlessly scales your data analytics & AI applications from laptop to cloud, with the following libraries: BigDL seamlessly scales your data analytics & AI applications from laptop to cloud, with the following libraries: