023555fb1f
* LLM: init one-click installer for windows * LLM: fix typo in one-click installer readme * LLM: one-click installer try except logic * LLM: one-click installer add dependency * LLM: one-click installer adjust README.md * LLM: one-click installer split README and add zip compress in setup.bat * LLM: one-click installer verified internlm and llama2 and replace gif * LLM: remove one-click installer images * LLM: finetune the one-click installer README.md * LLM: fix typo in one-click installer README.md * LLM: rename one-click installer to protable executable * LLM: rename other places to protable executable * LLM: rename the zip filename to executable * LLM: update .gitignore * LLM: add colorama to setup.bat
1.3 KiB
1.3 KiB
BigDL-LLM Portable Executable For Windows: User Guide
This portable executable includes everything you need to run LLM (except models). Please refer to How to use section to get started.
13B model running on an Intel 11-Gen Core PC (real-time screen capture)
Verified Models
- ChatGLM2-6b
- Baichuan-13B-Chat
- Baichuan2-7B-Chat
- internlm-chat-7b-8k
- Llama-2-7b-chat-hf
How to use
-
Download the model to your computer. Please ensure there is a file named
config.jsonin the model folder, otherwise the script won't work.
-
Run
chat.batin Terminal and input the path of the model (e.g.path\to\model, note that there's no slash at the end of the path).
-
Press Enter and wait until model finishes loading. Then enjoy chatting with the model!
-
If you want to stop chatting, just input
stopand the model will stop running.