ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

add version for llama.cpp and ollama (#10982)

Browse source 
* add version for cpp

* meet review
This commit is contained in:
Ruonan Wang 2024-05-11 09:20:31 +08:00 committed by GitHub
parent ad96f32ce0
commit 5e0872073e
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 12 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

6
docs/readthedocs/source/doc/LLM/Quickstart/llama_cpp_quickstart.md
View file

@ -6,6 +6,12 @@ See the demo of running LLaMA2-7B on Intel Arc GPU below.
<video src="https://llm-assets.readthedocs.io/en/latest/_images/llama-cpp-arc.mp4" width="100%" controls></video>
```eval_rst
.. note::
Our current version is consistent with `c780e75 <https://github.com/ggerganov/llama.cpp/commit/c780e75305dba1f67691a8dc0e8bc8425838a452>`_ of llama.cpp.
```
## Quick Start
This quickstart guide walks you through installing and running `llama.cpp` with `ipex-llm`.

6
docs/readthedocs/source/doc/LLM/Quickstart/ollama_quickstart.md
View file

@ -6,6 +6,12 @@ See the demo of running LLaMA2-7B on Intel Arc GPU below.
<video src="https://llm-assets.readthedocs.io/en/latest/_images/ollama-linux-arc.mp4" width="100%" controls></video>
```eval_rst
.. note::
Our current version is consistent with `v0.1.34 <https://github.com/ollama/ollama/releases/tag/v0.1.34>`_ of ollama.
```
## Quickstart
### 1 Install IPEX-LLM for Ollama