diff --git a/docs/readthedocs/source/doc/LLM/Quickstart/webui_quickstart.md b/docs/readthedocs/source/doc/LLM/Quickstart/webui_quickstart.md index 6133ba66..4d7c3acf 100644 --- a/docs/readthedocs/source/doc/LLM/Quickstart/webui_quickstart.md +++ b/docs/readthedocs/source/doc/LLM/Quickstart/webui_quickstart.md @@ -1,7 +1,7 @@ # Use Text Generation WebUI on Windows with Intel GPU -This quickstart guide walks you through setting up and using the **Text Generation WebUI** (a Gradio web UI for Large Language Models) with `bigdl-llm`. +This quickstart guide walks you through setting up and using the [Text Generation WebUI](https://github.com/intel-analytics/text-generation-webui) (a Gradio WebUI for running Large Language Models) with `bigdl-llm`. A preview of the WebUI in action is shown below: @@ -12,7 +12,7 @@ A preview of the WebUI in action is shown below: ## 1 Install BigDL-LLM -To use the WebUI, first ensure that BigDL-LLM is installed. Follow the instructions on the [BigDL-LLM Installation Quickstart for Windows with Intel GPU](https://github.com/intel-analytics/BigDL/blob/main/docs/readthedocs/source/doc/LLM/Quickstart/install_windows_gpu.md). +To use the WebUI, first ensure that BigDL-LLM is installed. Follow the instructions on the [BigDL-LLM Installation Quickstart for Windows with Intel GPU](install_windows_gpu.html). **After the installation, you should have created a conda environment, named `llm` for instance, for running `bigdl-llm` applications.** @@ -38,7 +38,7 @@ pip install -r requirements_cpu_only.txt ### Set Environment Variables If you're running on iGPUs, set some environment variables by running below commands in **Anaconda Prompt**: - > Note: For more details about runtime configurations, refer to [this link](https://bigdl.readthedocs.io/en/latest/doc/LLM/Overview/install_gpu.html#runtime-configuration): + > Note: For more details about runtime configurations, refer to [this link](../Overview/install_gpu.html#runtime-configuration): ```bash set SYCL_CACHE_PERSISTENT=1 set BIGDL_LLM_XMX_DISABLED=1 @@ -118,4 +118,4 @@ If there are still errors on missing packages, repeat the installation process f ### Compatiblity issues If you encounter **AttributeError** errors like shown below, it may be due to some models being incompatible with the current version of the transformers package because they are outdated. In such instances, using a more recent model is recommended. - \ No newline at end of file +