ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1
3838 commits 1 branch 0 tags 37 MiB
Commit graph

184 commits

Author SHA1 Message Date
Xu, Shuo
55ce091242
Add GLM4-Edge-V GPU example (#12596) 
* Add GLM4-Edge-V examples

* polish readme

* revert wrong changes

* polish readme

* polish readme

* little polish in reference info and indent

* Small fix and sample output updates

* Update main readme

---------

Co-authored-by: Yuwen Hu <yuwen.hu@intel.com>
 2024-12-27 09:40:29 +08:00
SONG Ge
f7a2bd21cf
Update ollama and llama.cpp readme (#12574) 2024-12-18 17:33:20 +08:00
Jason Dai
6e801bc4e1
Update readme (#12565) 2024-12-18 09:33:16 +08:00
Chu,Youcheng
a86487c539
Add GLM-Edge GPU example (#12483) 
* feat: initial commit

* generate.py and README updates

* Update link for main readme

* Update based on comments

* Small fix

---------

Co-authored-by: Yuwen Hu <yuwen.hu@intel.com>
 2024-12-16 14:39:19 +08:00
binbin Deng
6fc27da9c1
[NPU] Update glm-edge support in docs (#12529) 2024-12-12 11:14:09 +08:00
Yuwen Hu
60bafab855
Small fixes to main readme (#12508) 2024-12-05 16:08:43 +08:00
Jason Dai
0a3eda06d0
Update README.md (#12507) 2024-12-05 15:46:53 +08:00
Yuwen Hu
727f29968c
Add NPU demo gif to main readme (#12503) 
* Add NPU demo gif to main readme

* Small fix

* Update based on comments

* Test on style fix
 2024-12-05 12:24:27 +08:00
Jason Dai
80f15e41f5
Update README.md (#12489) 2024-12-03 18:02:28 +08:00
Yuwen Hu
aee9acb303
Add NPU QuickStart & update example links (#12470) 
* Add initial NPU quickstart (c++ part unfinished)

* Small update

* Update based on comments

* Update main readme

* Remove LLaMA description

* Small fix

* Small fix

* Remove subsection link in main README

* Small fix

* Update based on comments

* Small fix

* TOC update and other small fixes

* Update for Chinese main readme

* Update based on comments and other small fixes

* Change order
 2024-12-02 17:03:10 +08:00
Jinhe
d2a37b6ab2
add Stable diffusion examples (#12418) 
* add openjourney example

* add timing

* add stable diffusion to model page

* 4.1 fix

* small fix
 2024-11-20 17:18:36 +08:00
Jun Wang
4376fdee62
Decouple the openwebui and the ollama. in inference-cpp-xpu dockerfile (#12382) 
* remove the openwebui in inference-cpp-xpu dockerfile

* update docker_cpp_xpu_quickstart.md

* add sample output in inference-cpp/readme

* remove the openwebui in main readme

* remove the openwebui in main readme
 2024-11-12 20:15:23 +08:00
Jason Dai
1cef0c4948
Update README.md (#12286) 2024-10-28 17:06:16 +08:00
Jason Dai
a35cf4d533
Update README.md (#12242) 2024-10-22 10:19:07 +08:00
Yuwen Hu
7da3ab7322
Add missing link for Llama3.2-Vision (#12197) 2024-10-14 17:19:49 +08:00
Jinhe
f983f1a8f4
Add Qwen2-VL gpu example (#12135) 
* qwen2-vl readme

* add qwen2-vl example

* fix

* fix

* fix

* add link

* Update regarding modules_to_not_convert and readme

* Further fix

* Small fix

---------

Co-authored-by: Yuwen Hu <yuwen.hu@intel.com>
 2024-10-11 18:25:23 +08:00
Ch1y0q
17c23cd759
add llama3.2 GPU example (#12137) 
* add llama3.2 GPU example

* change prompt format reference url

* update

* add Meta-Llama-3.2-1B-Instruct sample output

* update wording
 2024-09-29 14:41:54 +08:00
Ch1y0q
2ea13d502f
Add minicpm3 gpu example (#12114) 
* add minicpm3 gpu example

* update GPU example

* update

---------

Co-authored-by: Huang, Xinshengzi <xinshengzi.huang@intel.com>
 2024-09-26 13:51:37 +08:00
Ch1y0q
2269768e71
add internvl2 example (#12102) 
* add internvl2 example

* add to README.md

* update

* add link to zh-CN readme
 2024-09-20 16:31:54 +08:00
joan726
ad1fe77fe6
Add language switching (#12096) 2024-09-20 16:05:20 +08:00
Jin, Qiao
db7500bfd4
Add Qwen2.5 GPU example (#12101) 
* Add Qwen2.5 GPU example

* fix end line

* fix description
 2024-09-20 15:55:57 +08:00
joan726
18714ceac7
Update README.md (#12084) 
Modify vLLM related links
 2024-09-14 15:24:08 +08:00
Jinhe
32e8362da7
added minicpm cpu examples (#12027) 
* minicpm cpu examples

* add link for minicpm-2
 2024-09-11 15:51:21 +08:00
Jin, Qiao
2e54f4402b
Rename MiniCPM-V-2_6 CPU example (#11998) 2024-09-03 16:50:42 +08:00
Jin, Qiao
65e281bb29
Add MiniCPM-V cpu example (#11975) 
* Add MiniCPM-V cpu example

* fix

* fix

* fix

* fix
 2024-09-02 10:17:57 +08:00
Ch1y0q
730d9ec811
Add Qwen2-audio example (#11835) 
* add draft for qwen2-audio

* update example for `Qwen2-Audio`

* update

* update

* add warmup
 2024-08-27 13:35:24 +08:00
Jinhe
a508b0a902
added link to minicpm-v-2_6 example (#11829) 2024-08-16 14:49:23 +08:00
Jason Dai
6a8d07ddb4
Update README.md (#11824) 2024-08-16 10:22:02 +08:00
Ch1y0q
4676af2054
add gemma2 example (#11724) 
* add `gemma2`

* update `transformers` version

* update `README.md`
 2024-08-06 21:17:50 +08:00
Jin, Qiao
808d9a7bae
Add MiniCPM-V-2 GPU example (#11699) 
* Add MiniCPM-V-2 GPU example

* add example in README.md

* add example in README.md
 2024-08-06 10:22:33 +08:00
Zijie Li
5079ed9e06
Add Llama3.1 example (#11689) 
* Add Llama3.1 example

Add Llama3.1 example for Linux arc and Windows MTL

* Changes made to adjust compatibilities

transformers changed to 4.43.1

* Update index.rst

* Update README.md

* Update index.rst

* Update index.rst

* Update index.rst
 2024-07-31 10:53:30 +08:00
Jason Dai
373ccbbb0c
Update README.md (#11592) 2024-07-16 22:13:43 +08:00
Ch1y0q
50cf563a71
Add example: MiniCPM-V (#11570) 2024-07-15 10:55:48 +08:00
Jason Dai
099486afb7
Update README.md (#11530) 2024-07-08 20:18:41 +08:00
binbin Deng
66f6ffe4b2
Update GPU HF-Transformers example structure (#11526) 2024-07-08 17:58:06 +08:00
Jason Dai
e9e8f9b4d4
Update Readme (#11441) 2024-06-26 19:48:07 +08:00
Jason Dai
2939f1ac60
Update README.md (#11439) 2024-06-26 19:25:58 +08:00
Yuwen Hu
a45ceac4e4
Update main readme for missing quickstarts (#11427) 
* Update main readme to add missing quckstart

* Update quickstart index page

* Small fixes

* Small fix
 2024-06-26 13:51:42 +08:00
Shengsheng Huang
475b0213d2
README update (API doc and FAQ and minor fixes) (#11397) 
* add faq and API doc link in README.md

* add missing quickstart link

* update links in FAQ

* update links in FAQ

* update faq

* update faq text
 2024-06-21 19:46:32 +08:00
Shengsheng Huang
072ce7e66d
update README links to mddocs (#11387) 
* update links to mddocs

* update links

* update links in texts

* update table html links
 2024-06-21 13:59:27 +08:00
ivy-lv11
21fc781fce
Add GLM-4V example (#11343) 
* add example

* modify

* modify

* add line

* add

* add link and replace with phi-3-vision template

* fix generate options

* fix

* fix

---------

Co-authored-by: jinbridge <2635480475@qq.com>
 2024-06-21 12:54:31 +08:00
Jason Dai
271d82a4fc
Update readme (#11357) 2024-06-19 10:05:42 +08:00
Jason Dai
bc4bafffc7
Update README.md (#11335) 2024-06-17 16:24:23 +08:00
Shengsheng Huang
d99423b75a
Readme demo (#11283) 2024-06-12 17:01:53 +08:00
Jin Qiao
f224e98297
Add GLM-4 CPU example (#11223) 
* Add GLM-4 example

* add tiktoken dependency

* fix

* fix
 2024-06-12 15:30:51 +08:00
Yuwen Hu
375174af33
Small qwen2 link fix (#11255) 2024-06-07 10:37:32 +08:00
Yuwen Hu
8c36b5bdde
Add qwen2 example (#11252) 
* Add GPU example for Qwen2

* Update comments in README

* Update README for Qwen2 GPU example

* Add CPU example for Qwen2

Sample Output under README pending

* Update generate.py and README for CPU Qwen2

* Update GPU example for Qwen2

* Small update

* Small fix

* Add Qwen2 table

* Update README for Qwen2 CPU and GPU

Update sample output under README

---------

Co-authored-by: Zijie Li <michael20001122@gmail.com>
 2024-06-07 10:29:33 +08:00
Zijie Li
bfa1367149
Add CPU and GPU example for MiniCPM (#11202) 
* Change installation address

Change former address: "https://docs.conda.io/en/latest/miniconda.html#" to new address: "https://conda-forge.org/download/" for 63 occurrences under python\llm\example

* Change Prompt

Change "Anaconda Prompt" to "Miniforge Prompt" for 1 occurrence

* Create and update model minicpm

* Update model minicpm

Update model minicpm under GPU/PyTorch-Models

* Update readme and generate.py

change "prompt = tokenizer.apply_chat_template(chat, tokenize=False, add_generation_prompt=False)" and delete "pip install transformers==4.37.0
"

* Update comments for minicpm GPU

Update comments for generate.py at minicpm GPU

* Add CPU example for MiniCPM

* Update minicpm README for CPU

* Update README for MiniCPM and Llama3

* Update Readme for Llama3 CPU Pytorch

* Update and fix comments for MiniCPM
 2024-06-05 18:09:53 +08:00
Jin Qiao
dcbf4d3d0a
Add phi-3-vision example (#11156) 
* Add phi-3-vision example (HF-Automodels)

* fix

* fix

* fix

* Add phi-3-vision CPU example (HF-Automodels)

* add in readme

* fix

* fix

* fix

* fix

* use fp8 for gpu example

* remove eval
 2024-05-30 10:02:47 +08:00
Wang, Jian4
8e25de1126
LLM: Add codegeex2 example (#11143) 
* add codegeex example

* update

* update cpu

* add GPU

* add gpu

* update readme
 2024-05-29 10:00:26 +08:00