ipex-llm/python/llm/example
Yuwen Hu c619315131 [LLM] Add examples for gptneox, llama, and bloom family model using transformers-like API (#8286)
* First push of bigdl-llm example for gptneox model family

* Add some args and other small updates

* Small updates

* Add example for llama family models

* Small fix

* Small fix

* Update for batch_decode api and change default model for llama example

* Small fix

* Small fix

* Small fix

* Small model family name fix and add example for bloom

* Small fix

* Small default prompt fix

* Small fix

* Change default prompt

* Add sample output for inference

* Hide example inference time
2023-06-09 15:48:22 +08:00
..
bloom [LLM] Add examples for gptneox, llama, and bloom family model using transformers-like API (#8286) 2023-06-09 15:48:22 +08:00
gptneox [LLM] Add examples for gptneox, llama, and bloom family model using transformers-like API (#8286) 2023-06-09 15:48:22 +08:00
llama [LLM] Add examples for gptneox, llama, and bloom family model using transformers-like API (#8286) 2023-06-09 15:48:22 +08:00