hxsz1997
44f22cba70
add config and default value ( #11344 )
...
* add config and default value
* add config in taml
* remove lookahead and max_matching_ngram_size in config
* remove streaming and use_fp16_torch_dtype in test yaml
* update task in readme
* update commit of task
2024-06-18 15:28:57 +08:00
Zhao Changmin
15d906a97b
Update linux igpu run script ( #11098 )
...
* update run script
2024-05-22 17:18:07 +08:00
Shengsheng Huang
0b7e78b592
revise the benchmark part in python inference docker ( #11020 )
2024-05-14 18:43:41 +08:00
Qiyuan Gong
bce99a5b00
Minior fix for quick start ( #10857 )
...
* Fix typo and space in quick start.
2024-04-23 15:22:01 +08:00
Shengsheng Huang
45437ddc9a
update indexes, move some sections in coding quickstart to webui ( #10651 )
2024-04-03 18:18:49 +08:00
Kai Huang
e619142a16
Add SYCL_CACHE_PERSISTENT in doc and explain warmup in benchmark quickstart ( #10571 )
...
* update doc
* update
2024-03-27 21:03:51 +08:00
Wang, Jian4
16b2ef49c6
Update_document by heyang ( #30 )
2024-03-25 10:06:02 +08:00
Lilac09
aec83a8be6
Fix user guide indent ( #10393 )
2024-03-13 09:49:07 +08:00
Lilac09
5809a3f5fe
Add run-hbm.sh & add user guide for spr and hbm ( #10357 )
...
* add run-hbm.sh
* add spr and hbm guide
* only support quad mode
* only support quad mode
* update special cases
* update special cases
2024-03-12 16:15:27 +08:00
WeiguangHan
cac96b00be
LLM: Small fix for benchmark userguide ( #10373 )
...
* small fix for benchmark userguide
* resolve some comments
2024-03-12 12:26:26 +08:00
WeiguangHan
f4cef95690
LLM: some slight modification to benchmark user guide ( #10347 )
2024-03-08 19:43:12 +08:00
WeiguangHan
db00e79cdf
LLM: add user guide for benchmarking ( #10284 )
...
* add user guide for benchmarking
* change the name and place of the benchmark user guide
* resolve some comments
* resolve new comments
* modify some typo
* resolve some new comments
* modify some descriptions
2024-03-07 18:50:29 +08:00