diff --git a/docs/readthedocs/source/doc/LLM/Overview/FAQ/resolve_error.md b/docs/readthedocs/source/doc/LLM/Overview/FAQ/resolve_error.md index 8d1fc312..71348cca 100644 --- a/docs/readthedocs/source/doc/LLM/Overview/FAQ/resolve_error.md +++ b/docs/readthedocs/source/doc/LLM/Overview/FAQ/resolve_error.md @@ -58,6 +58,16 @@ You could use `export BIGDL_LLM_AMX_DISABLED=1` to disable AMX manually and solv You may encounter this error during finetuning on multi GPUs. Please try `sudo apt install level-zero-dev` to fix it. +### random and unreadable output of Gemma-7b-it on Arc770 ubuntu 22.04 due to driver and OneAPI missmatching. + +If driver and OneAPI missmatching, it will lead to some error when BigDL use XMX(short prompts) for speeding up. +The output of `What's AI?` may like below: +``` +wiedzy Artificial Intelligence meliti: Artificial Intelligence undenti beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng +``` +If you meet this error. Please check your driver version and OneAPI version. Commnad is `sudo apt list --installed | egrep "intel-basekit|intel-level-zero-gpu"`. +Make sure intel-basekit>=2024.0.1-43 and intel-level-zero-gpu>=1.3.27191.42-775~22.04. + ### Too many open files You may encounter this error during finetuning, expecially when run 70B model. Please raise the system open file limit using `ulimit -n 1048576`. diff --git a/docs/readthedocs/source/doc/LLM/Overview/install_gpu.md b/docs/readthedocs/source/doc/LLM/Overview/install_gpu.md index ea7e352e..f1d0054c 100644 --- a/docs/readthedocs/source/doc/LLM/Overview/install_gpu.md +++ b/docs/readthedocs/source/doc/LLM/Overview/install_gpu.md @@ -530,15 +530,6 @@ The following packages have unmet dependencies: You can use `sudo apt install -y intel-i915-dkms intel-fw-gpu` to install instead. As the intel-platform-cse-dkms and intel-platform-vsec-dkms are already provided by intel-i915-dkms. -### 3. Gemma-7b-it's output is random and unreadable on Arc770 ubuntu 22.04. - -The output of `What's AI?` like: -``` -wiedzy Artificial Intelligence meliti: Artificial Intelligence undenti beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng -``` -Please check your driver version and OneAPI version. Commnad is `sudo apt list --installed | egrep "intel-basekit|intel-level-zero-gpu"`. -Make sure intel-basekit>=2024.0.1-43 and intel-level-zero-gpu>=1.3.27191.42-775~22.04. - ### Troubleshooting #### 1. Cannot open shared object file: No such file or directory diff --git a/python/llm/example/GPU/HF-Transformers-AutoModels/Model/gemma/README.md b/python/llm/example/GPU/HF-Transformers-AutoModels/Model/gemma/README.md index 50790f7b..74dda0cd 100644 --- a/python/llm/example/GPU/HF-Transformers-AutoModels/Model/gemma/README.md +++ b/python/llm/example/GPU/HF-Transformers-AutoModels/Model/gemma/README.md @@ -138,12 +138,12 @@ model ``` ### 5. Know issue -Gemma-7b-it's output is random and unreadable on Arc770 ubuntu 22.04. +#### 1. Random and unreadable output of Gemma-7b-it on Arc770 ubuntu 22.04 due to driver and OneAPI missmatching. -The output of `What's AI?` like: +If driver and OneAPI missmatching, it will lead to some error when BigDL use XMX(short prompts) for speeding up. +The output of `What's AI?` may like below: ``` wiedzy Artificial Intelligence meliti: Artificial Intelligence undenti beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng beng ``` -Please check your driver version and OneAPI version. Commnad is `sudo apt list --installed | egrep "intel-basekit|intel-level-zero-gpu"`. +If you meet this error. Please check your driver version and OneAPI version. Commnad is `sudo apt list --installed | egrep "intel-basekit|intel-level-zero-gpu"`. Make sure intel-basekit>=2024.0.1-43 and intel-level-zero-gpu>=1.3.27191.42-775~22.04. -