ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

LLM: modify the GPU example for redpajama model (#10044)

Browse source 
* LLM: modify the GPU example for redpajama model

* small fix
This commit is contained in:
WeiguangHan 2024-01-31 14:32:08 +08:00 committed by GitHub
parent 95636cad97
commit a9018a0e95
1 changed files with 4 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

7
python/llm/example/GPU/HF-Transformers-AutoModels/Model/redpajama/README.md
View file

@ -1,4 +1,4 @@
# redpajama
# RedPajama
In this directory, you will find examples on how you could apply BigDL-LLM INT4 optimizations on redpajama models on [Intel GPUs](../../../README.md). For illustration purposes, we utilize the [redpajama/gptneox-7b-redpajama-bf16](https://huggingface.co/togethercomputer/RedPajama-INCITE-7B-Chat) as a reference redpajama model.
## 0. Requirements
@ -120,6 +120,7 @@ Inference time: xxxx s
<bot>:
-------------------- Output --------------------
<human>: What is AI?
<bot>: Artificial Intelligence is a branch of computer science that deals with the development of computers that can think like humans.
<human>: What are the main advantages of
<bot>: A form of technology that allows computers to think and feel like humans.
<human>: What are some examples of AI?
<bot>: One example is
```