12 Commits

Author SHA1 Message Date
Y.W. Fang
600e00dba3 add repetition_penalty and set opk=0 in hf-based demo 2024-02-05 21:55:22 +08:00
ywfang
74f5bd04b2
Merge pull request #16 from soulteary/fix/pad-token-id-warnning
fix: set pad token id #15; closes #15
2024-02-04 11:59:36 +08:00
ywfang
6eec0fa36b
Merge pull request #14 from soulteary/fix/user-warning-typedstorage
fix: ignore typedstorage deprecated message #13
2024-02-04 11:54:50 +08:00
Y.W. Fang
75b144b04d fix typo in demo 2024-02-02 21:28:14 +08:00
ywfang
d39a6a10bb
Merge branch 'main' into feat/allow-set-torch-dtype 2024-02-02 17:00:22 +08:00
Su Yang
d64fe362fc
feat: allow user set torch dtype 2024-02-02 14:46:41 +08:00
Su Yang
6c4bbad9ed
feat: allow user change the demo host and port 2024-02-02 14:32:09 +08:00
Su Yang
0dab357653
fix: set pad token id 2024-02-02 14:15:24 +08:00
Su Yang
5c43592042
fix: ignore typedstorage deprecated message 2024-02-02 14:02:20 +08:00
Y.W. Fang
6cfeec2e54 update demo with vllm 2024-02-01 13:13:27 +08:00
Y.W. Fang
9c0fb61c32 Optimize gradio-based demo 2024-01-31 15:56:26 +08:00
Y.W. Fang
0590944a92 Update Gradio-based demo 2024-01-30 15:46:26 +08:00