ipex-llm/docs/readthedocs/source/doc/LLM/Overview/examples.rst
2024-03-25 10:06:02 +08:00

9 lines
420 B
ReStructuredText

IPEX-LLM Examples
================================
You can use IPEX-LLM to run any PyTorch model with INT4 optimizations on Intel XPU (from Laptop to GPU to Cloud).
Here, we provide examples to help you quickly get started using IPEX-LLM to run some popular open-source models in the community. Please refer to the appropriate guide based on your device:
* `CPU <./examples_cpu.html>`_
* `GPU <./examples_gpu.html>`_