mirror of
https://github.com/RYDE-WORK/MiniCPM.git
synced 2026-02-01 20:33:50 +08:00
Merge branch 'OpenBMB:main' into main
This commit is contained in:
commit
18efe83dbe
@ -172,7 +172,10 @@ print(res)
|
|||||||
|
|
||||||
#### vLLM
|
#### vLLM
|
||||||
|
|
||||||
* Install [vLLM](https://github.com/vllm-project/vllm) main: [build from source](https://docs.vllm.ai/en/latest/getting_started/installation.html#build-from-source)。
|
* Install [vLLM](https://github.com/vllm-project/vllm)
|
||||||
|
```shell
|
||||||
|
pip install "vllm>=0.4.1"
|
||||||
|
```
|
||||||
|
|
||||||
* Examples
|
* Examples
|
||||||
```shell
|
```shell
|
||||||
|
|||||||
@ -174,7 +174,10 @@ print(res)
|
|||||||
|
|
||||||
#### vLLM 推理
|
#### vLLM 推理
|
||||||
|
|
||||||
* 安装[vLLM](https://github.com/vllm-project/vllm)主分支版本: [从源码安装](https://docs.vllm.ai/en/latest/getting_started/installation.html#build-from-source)。
|
* 安装[vLLM](https://github.com/vllm-project/vllm)
|
||||||
|
```shell
|
||||||
|
pip install "vllm>=0.4.1"
|
||||||
|
```
|
||||||
|
|
||||||
* 测试样例
|
* 测试样例
|
||||||
```shell
|
```shell
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user