RYDE-WORK/MiniCPM
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/MiniCPM.git synced 2026-01-19 12:53:36 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

对poworinfer的教程做了少量的改进

Browse Source
This commit is contained in:
root 2024-07-08 10:35:47 +08:00
parent 6070710463
commit 3c3caa5d35
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
README.md
View File

@ -303,12 +303,12 @@ powerinfer目前仅针对MiniCPM-S-1B模型，其他版本暂不支持，敬请
cd PowerInfer cd PowerInfer
pip install -r requirements.txt # install Python helpers' dependencies pip install -r requirements.txt # install Python helpers' dependencies
``` ```
3. cpu版本powerinfer编译： 3. cpu版本powerinfer编译,如果你的机器只有cpu，或者只想使用cpu进行推理，则运行以下命令：
```bash ```bash
cmake -S . -B build cmake -S . -B build
cmake --build build --config Release cmake --build build --config Release
``` ```
4. gpu版本powerinfer编译： 4. gpu版本powerinfer编译,如果你的机器有gpu，则可以运行以下命令：
```bash ```bash
cmake -S . -B build -DLLAMA_CUBLAS=ON cmake -S . -B build -DLLAMA_CUBLAS=ON
cmake --build build --config Release cmake --build build --config Release