mirror of
https://github.com/RYDE-WORK/MiniCPM.git
synced 2026-01-19 12:53:36 +08:00
Merge branch 'OpenBMB:main' into main
This commit is contained in:
commit
18efe83dbe
@ -172,7 +172,10 @@ print(res)
|
||||
|
||||
#### vLLM
|
||||
|
||||
* Install [vLLM](https://github.com/vllm-project/vllm) main: [build from source](https://docs.vllm.ai/en/latest/getting_started/installation.html#build-from-source)。
|
||||
* Install [vLLM](https://github.com/vllm-project/vllm)
|
||||
```shell
|
||||
pip install "vllm>=0.4.1"
|
||||
```
|
||||
|
||||
* Examples
|
||||
```shell
|
||||
|
||||
@ -174,7 +174,10 @@ print(res)
|
||||
|
||||
#### vLLM 推理
|
||||
|
||||
* 安装[vLLM](https://github.com/vllm-project/vllm)主分支版本: [从源码安装](https://docs.vllm.ai/en/latest/getting_started/installation.html#build-from-source)。
|
||||
* 安装[vLLM](https://github.com/vllm-project/vllm)
|
||||
```shell
|
||||
pip install "vllm>=0.4.1"
|
||||
```
|
||||
|
||||
* 测试样例
|
||||
```shell
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user