mirror of
https://github.com/RYDE-WORK/Langchain-Chatchat.git
synced 2026-02-08 07:53:29 +08:00
update readme
This commit is contained in:
parent
8477adfa33
commit
c591dd7836
@ -289,7 +289,7 @@ $ python server/llm_api_shutdown.py --serve all
|
|||||||
示例代码如下:
|
示例代码如下:
|
||||||
|
|
||||||
```shell
|
```shell
|
||||||
PEFT_SHARE_BASE_WEIGHTS=true python3 -m FastChat.serve.multi_model_worker \
|
PEFT_SHARE_BASE_WEIGHTS=true python3 -m fastchat.serve.multi_model_worker \
|
||||||
--model-path /data/chris/peft-llama-dummy-1 \
|
--model-path /data/chris/peft-llama-dummy-1 \
|
||||||
--model-names peft-dummy-1 \
|
--model-names peft-dummy-1 \
|
||||||
--model-path /data/chris/peft-llama-dummy-2 \
|
--model-path /data/chris/peft-llama-dummy-2 \
|
||||||
@ -299,7 +299,7 @@ PEFT_SHARE_BASE_WEIGHTS=true python3 -m FastChat.serve.multi_model_worker \
|
|||||||
--num-gpus 2
|
--num-gpus 2
|
||||||
```
|
```
|
||||||
|
|
||||||
详见 [FastChat 相关 PR](https://github.com/lm-sys/FastChat/pull/1905#issuecomment-1627801216)
|
详见 https://github.com/lm-sys/FastChat/pull/1905#issuecomment-1627801216
|
||||||
|
|
||||||
#### 5.2 启动 API 服务
|
#### 5.2 启动 API 服务
|
||||||
|
|
||||||
|
|||||||
Loading…
x
Reference in New Issue
Block a user