RYDE-WORK/MiniCPM
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/MiniCPM.git synced 2026-02-03 21:53:45 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
DingDing 2024-02-02 08:14:45 +08:00 committed by GitHub
parent 85e39ec377
commit 260b2d930f
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
README.md
View File

@ -109,6 +109,7 @@ python inference.py --model_path <vllmcpm_repo_path> --prompt_path prompts/promp
``` ```
#### Huggingface 模型 #### Huggingface 模型
（注：我们发现当前Huggingface的推理代码推理效果差于Vllm的推理代码，我们正在对齐中，请耐心等待）
##### MiniCPM-2B ##### MiniCPM-2B
* 安装`transformers>=4.36.0`以及`accelerate`后，运行以下代码 * 安装`transformers>=4.36.0`以及`accelerate`后，运行以下代码
```python ```python