ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Remove ipex-llm dependency in readme (#10544)

Browse source
This commit is contained in:
Jin Qiao 2024-03-26 18:25:14 +08:00 committed by GitHub
parent 11550d3f25
commit b78289a595
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 0 additions and 20 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

20
python/llm/README.md
View file

@ -109,7 +109,6 @@ Over 20 models have been optimized/verified on `ipex-llm`, including *LLaMA/LLaM
- [3. LangChain API](#3-langchain-api) - [3. LangChain API](#3-langchain-api)
- [4. CLI Tool](#4-cli-tool) - [4. CLI Tool](#4-cli-tool)
- [`ipex-llm` API Doc](#ipex-llm-api-doc) - [`ipex-llm` API Doc](#ipex-llm-api-doc)
- [`ipex-llm` Dependency](#ipex-llm-dependency)
</details> </details>
@ -304,22 +303,3 @@ You may run the models using the LangChain API in `ipex-llm`.
See the inital `ipex-llm` API Doc [here](https://ipex-llm.readthedocs.io/en/latest/doc/PythonAPI/LLM/index.html). See the inital `ipex-llm` API Doc [here](https://ipex-llm.readthedocs.io/en/latest/doc/PythonAPI/LLM/index.html).
[^1]: Performance varies by use, configuration and other factors. `ipex-llm` may not optimize to the same degree for non-Intel products. Learn more at www.Intel.com/PerformanceIndex. [^1]: Performance varies by use, configuration and other factors. `ipex-llm` may not optimize to the same degree for non-Intel products. Learn more at www.Intel.com/PerformanceIndex.
### `ipex-llm` Dependency
The native code/lib in `ipex-llm` has been built using the following tools.
Note that lower `LIBC` version on your Linux system may be incompatible with `ipex-llm`.
| Model family | Platform | Compiler | GLIBC |
| ------------ | -------- | ------------------ | ----- |
| llama | Linux | GCC 11.2.1 | 2.17 |
| llama | Windows | MSVC 19.36.32532.0 | |
| llama | Windows | GCC 13.1.0 | |
| gptneox | Linux | GCC 11.2.1 | 2.17 |
| gptneox | Windows | MSVC 19.36.32532.0 | |
| gptneox | Windows | GCC 13.1.0 | |
| bloom | Linux | GCC 11.2.1 | 2.29 |
| bloom | Windows | MSVC 19.36.32532.0 | |
| bloom | Windows | GCC 13.1.0 | |
| starcoder | Linux | GCC 11.2.1 | 2.29 |
| starcoder | Windows | MSVC 19.36.32532.0 | |
| starcoder | Windows | GCC 13.1.0 | |