ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Llm ppl workflow bug fix (#10128)

Browse source 
* add llm-ppl workflow

* update the DATASET_DIR

* test multiple precisions

* modify nightly test

* match the updated ppl code

* add matrix.include

* fix the include error

* update the include

* add more model

* update the precision of include

* update nightly time and add more models

* fix the workflow_dispatch description, change default model of pr and modify the env

* modify workflow_dispatch language options

* modify options

* modify language options

* modeify workflow_dispatch type

* modify type

* modify the type of language

* change seq_len type
This commit is contained in:
hxsz1997 2024-02-07 18:48:14 +08:00 committed by GitHub
parent 76bd792ff1
commit b4c327ea78
1 changed files with 5 additions and 9 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

14
.github/workflows/llm-ppl-evaluation.yml vendored
View file

@ -17,9 +17,9 @@ on:
workflow_dispatch: workflow_dispatch:
inputs: inputs:
seq_len: seq_len:
description: 'sequence length, input one number' description: 'sequence length, input one number and must be quoted.'
required: true required: true
type: number type: string
model_name: model_name:
description: 'Model names, seperated by comma and must be quoted.' description: 'Model names, seperated by comma and must be quoted.'
required: true required: true
@ -29,13 +29,9 @@ on:
required: true required: true
type: string type: string
language: language:
description: 'language, can be en, zh, or all' description: 'language, can be en, zh, or all and must be quoted.'
required: true required: true
type: choice type: string
options:
- "en"
- "zh"
- "all"
runs-on: runs-on:
description: 'Labels to filter the runners, seperated by comma and must be quoted.' description: 'Labels to filter the runners, seperated by comma and must be quoted.'
default: "accuracy" default: "accuracy"
@ -202,4 +198,4 @@ jobs:
--precisions ${{ matrix.precision }} \ --precisions ${{ matrix.precision }} \
--device ${{ matrix.device }} \ --device ${{ matrix.device }} \
--dataset_path ${DATASET_DIR} \ --dataset_path ${DATASET_DIR} \
--language ${{ matrix.language }} --language ${{ matrix.language }}