5 Commits

Author	SHA1	Message	Date
Y.W. Fang	75b144b04d	fix typo in demo	2024-02-02 21:28:14 +08:00
ywfang	d39a6a10bb	Merge branch 'main' into feat/allow-set-torch-dtype	2024-02-02 17:00:22 +08:00
Su Yang	d64fe362fc	feat: allow user set torch dtype	2024-02-02 14:46:41 +08:00
Su Yang	6c4bbad9ed	feat: allow user change the demo host and port	2024-02-02 14:32:09 +08:00
Y.W. Fang	6cfeec2e54	update demo with vllm	2024-02-01 13:13:27 +08:00