Merge branch 'OpenBMB:main' into main

This commit is contained in:
zR 2024-04-24 20:09:12 +08:00 committed by GitHub
commit 18efe83dbe
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
2 changed files with 8 additions and 2 deletions

View File

@ -172,7 +172,10 @@ print(res)
#### vLLM
* Install [vLLM](https://github.com/vllm-project/vllm) main: [build from source](https://docs.vllm.ai/en/latest/getting_started/installation.html#build-from-source)。
* Install [vLLM](https://github.com/vllm-project/vllm)
```shell
pip install "vllm>=0.4.1"
```
* Examples
```shell

View File

@ -174,7 +174,10 @@ print(res)
#### vLLM 推理
* 安装[vLLM](https://github.com/vllm-project/vllm)主分支版本: [从源码安装](https://docs.vllm.ai/en/latest/getting_started/installation.html#build-from-source)。
* 安装[vLLM](https://github.com/vllm-project/vllm)
```shell
pip install "vllm>=0.4.1"
```
* 测试样例
```shell