huangyuxiang03 d31bb7b569 update vllm instructions

2024-02-01 14:50:56 +08:00

..

infer_cpm

update vllm instructions

2024-02-01 14:50:56 +08:00

infer_cpm_mistral

Add: vllm

2024-02-01 10:54:48 +08:00

api_client.py

Add: vllm

2024-02-01 10:54:48 +08:00

gradio_webserver.py

Add: vllm

2024-02-01 10:54:48 +08:00

llm_engine_example.py

Add: vllm

2024-02-01 10:54:48 +08:00

offline_inference.py

Add: vllm

2024-02-01 10:54:48 +08:00

openai_chatcompletion_client.py

Add: vllm

2024-02-01 10:54:48 +08:00

openai_completion_client.py

Add: vllm

2024-02-01 10:54:48 +08:00