ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

fix a typo in yuan (#10503)

Browse source
This commit is contained in:
Yishuo Wang 2024-03-22 09:40:04 +08:00 committed by GitHub
parent a7d38bee94
commit f0f317b6cf
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
python/llm/src/bigdl/llm/transformers/models/yuan.py
View file

@ -394,7 +394,7 @@ def yuan_attention_forward_origin(
self.head_dim,
cache_k.size(2),
kv_seq_len + KV_CACHE_ALLOC_BLOCK_LENGTH,
dtype=cache_k.d_type,
dtype=cache_k.dtype,
device=device)
new_cache_k[:] = cache_k
new_cache_v[:] = cache_v