ipex-llm/docs/readthedocs
Zijie Li bfa1367149
Add CPU and GPU example for MiniCPM (#11202)
* Change installation address

Change former address: "https://docs.conda.io/en/latest/miniconda.html#" to new address: "https://conda-forge.org/download/" for 63 occurrences under python\llm\example

* Change Prompt

Change "Anaconda Prompt" to "Miniforge Prompt" for 1 occurrence

* Create and update model minicpm

* Update model minicpm

Update model minicpm under GPU/PyTorch-Models

* Update readme and generate.py

change "prompt = tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=False)" and delete "pip install transformers==4.37.0
"

* Update comments for minicpm GPU

Update comments for generate.py at minicpm GPU

* Add CPU example for MiniCPM

* Update minicpm README for CPU

* Update README for MiniCPM and Llama3

* Update Readme for Llama3 CPU Pytorch

* Update and fix comments for MiniCPM
2024-06-05 18:09:53 +08:00
..
_build add docs 2021-10-12 11:06:44 +08:00
image [Doc] IPEX-LLM Doc Layout Update (#10532) 2024-03-25 16:23:56 +08:00
source Add CPU and GPU example for MiniCPM (#11202) 2024-06-05 18:09:53 +08:00
make.bat add docs 2021-10-12 11:06:44 +08:00
Makefile add docs 2021-10-12 11:06:44 +08:00
README.md [Doc] IPEX-LLM Doc Layout Update (#10532) 2024-03-25 16:23:56 +08:00

IPEX-LLM Documentation

This is the repository for IPEX-LLM documentation, which is hosted at https://ipex-llm.readthedocs.io/en/latest/

Local build

1. Set up environment

To build IPEX-LLM documentation locally for testing purposes, it is recommended to create a conda environment with specified Python version:

conda create -n docs python=3.7
conda activate docs

Then inside ipex-llm/docs/readthedocs folder, install required packages:

cd docs/readthedocs
# for reproducing ReadtheDocs deployment environment
pip install --upgrade pip "setuptools<58.3.0"
pip install --upgrade pillow mock==1.0.1 "alabaster>=0.7,<0.8,!=0.7.5" commonmark==0.9.1 recommonmark==0.5.0 sphinx sphinx-rtd-theme "readthedocs-sphinx-ext<2.3"

# for other documentation related dependencies
wget https://raw.githubusercontent.com/analytics-zoo/gha-cicd-env/main/python-requirements/requirements-doc.txt
pip install -r requirements-doc.txt

Note

: When adding new sphinx extensions for our documentation, the requirements file located here should be modified.

2. Build the documentation

You can then build the documentation locally through:

make html

Tips: If you meet building error Notebook error: Pandoc wasn't found, try conda install pandoc to resolve it.

Note

: The built files inside docs/readthedocs/_build/html dictionary should not be committed, they are only for testing purposes.

3. Test the documentation

To view the documentation locally, you could set up a testing server:

cd _build/html
python -m http.server 8000

The documentation can then be reached at http://localhost:8000/.

Note

: If you are setting up the testing server on a remote machine, it is recommended to forward port 8000 through VSCode, so that you could reach http://localhost:8000/ normally as on your local machine.