diff --git a/python/llm/portable-zip/README.md b/python/llm/portable-zip/README.md index a8202f55..182e4766 100644 --- a/python/llm/portable-zip/README.md +++ b/python/llm/portable-zip/README.md @@ -6,9 +6,8 @@ This portable zip includes everything you need to run an LLM with BigDL-LLM opti ### 13B model running on an Intel 11-Gen Core PC (real-time screen capture) -

- - +

+

### Verified Models @@ -26,12 +25,18 @@ This portable zip includes everything you need to run an LLM with BigDL-LLM opti 3. Unzip `bigdl-llm.zip`. 4. Download the model to your computer. Please ensure there is a file named `config.json` in the model folder, otherwise the script won't work. - ![](https://llm-assets.readthedocs.io/en/latest/_images/one-click-installer-user-guide-step1.png) +

+ +

5. Go into the unzipped folder and double click `chat.bat`. Input the path of the model (e.g. `path\to\model`, note that there's no slash at the end of the path). Press Enter and wait until model finishes loading. Then enjoy chatting with the model! - ![](https://llm-assets.readthedocs.io/en/latest/_images/one-click-installer-user-guide-step2.png) +

+ +

6. If you want to stop chatting, just input `stop` and the model will stop running. - ![](https://llm-assets.readthedocs.io/en/latest/_images/one-click-installer-user-guide-step34.png) +

+ +

\ No newline at end of file