zR 9e1438682e mlx inference

2024-03-26 21:07:54 +08:00

..

hf_based_demo.py

add repetition_penalty and set opk=0 in hf-based demo

2024-02-05 21:55:22 +08:00

mlx_based_demo.py

mlx inference

2024-03-26 21:07:54 +08:00

vllm_based_demo.py

fix typo in demo

2024-02-02 21:28:14 +08:00