ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Initial LLM Transformers example refactor (#8491)

Browse source
This commit is contained in:
Yuwen Hu 2023-07-10 17:53:57 +08:00 committed by GitHub
parent 254a7aa3c4
commit 52c6b057d6
5 changed files with 2 additions and 2 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
python/llm/README.md
View file

@ -100,7 +100,7 @@ You may run the models using `transformers`-style API in `bigdl-llm`.
output = tokenizer.batch_decode(output_ids)
```
See the complete example [here](example/transformers/transformers_int4_pipeline.py).
See the complete example [here](example/transformers/transformers_int4/transformers_int4_pipeline.py).
- ##### Using native INT4 format
@ -124,7 +124,7 @@ You may run the models using `transformers`-style API in `bigdl-llm`.
output = llm.batch_decode(output_ids)
```
See the complete example [here](example/transformers/native_int4_pipeline.py).
See the complete example [here](example/transformers/native_int4/native_int4_pipeline.py).
#### LangChain API
You may run the models using the LangChain API in `bigdl-llm`.

0
python/llm/example/transformers/native_int4_pipeline.py → python/llm/example/transformers/native_int4/native_int4_pipeline.py
View file

0
python/llm/example/transformers/native_int4_pipeline_readme.md → python/llm/example/transformers/native_int4/native_int4_pipeline_readme.md
View file

0
python/llm/example/transformers/transformers_int4_pipeline.py → python/llm/example/transformers/transformers_int4/transformers_int4_pipeline.py
View file

0
python/llm/example/transformers/transformers_int4_pipeline_readme.md → python/llm/example/transformers/transformers_int4/transformers_int4_pipeline_readme.md
View file