zR 3e7c74ec7a 128k模型无法推理的问题修复

2024-04-14 19:00:46 +08:00

..

openai_api_demo

OpenAI 推理简单应用

2024-04-11 19:31:08 +08:00

hf_based_demo.py

openai api需要的依赖，requirement推理依赖

2024-04-13 23:16:59 +08:00

mlx_based_demo.py

mlx inference

2024-03-26 21:07:54 +08:00

vllm_based_demo.py

128k模型无法推理的问题修复

2024-04-14 19:00:46 +08:00