RYDE-WORK/MiniCPM
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/MiniCPM.git synced 2026-02-02 21:23:55 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #16 from soulteary/fix/pad-token-id-warnning

Browse Source 
fix: set pad token id #15; closes #15
This commit is contained in:
ywfang 2024-02-04 11:59:36 +08:00 committed by GitHub
commit 74f5bd04b2
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
demo/hf_based_demo.py
View File

@ -60,6 +60,7 @@ def hf_gen(dialog: List, top_p: float, temperature: float, max_dec_len: int):
top_p=top_p, top_p=top_p,
temperature=temperature, temperature=temperature,
max_new_tokens=max_dec_len, max_new_tokens=max_dec_len,
pad_token_id=tokenizer.eos_token_id,
streamer=streamer, streamer=streamer,
) )
thread = Thread(target=model.generate, kwargs=generation_kwargs) thread = Thread(target=model.generate, kwargs=generation_kwargs)