From 3c3caa5d3538df3677bcab7875b36675408bab11 Mon Sep 17 00:00:00 2001 From: root <403644786@qq.com> Date: Mon, 8 Jul 2024 10:35:47 +0800 Subject: [PATCH] =?UTF-8?q?=E5=AF=B9poworinfer=E7=9A=84=E6=95=99=E7=A8=8B?= =?UTF-8?q?=E5=81=9A=E4=BA=86=E5=B0=91=E9=87=8F=E7=9A=84=E6=94=B9=E8=BF=9B?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index ad1b00f..34c122c 100644 --- a/README.md +++ b/README.md @@ -303,12 +303,12 @@ powerinfer目前仅针对MiniCPM-S-1B模型,其他版本暂不支持,敬请 cd PowerInfer pip install -r requirements.txt # install Python helpers' dependencies ``` -3. cpu版本powerinfer编译: +3. cpu版本powerinfer编译,如果你的机器只有cpu,或者只想使用cpu进行推理,则运行以下命令: ```bash cmake -S . -B build cmake --build build --config Release ``` -4. gpu版本powerinfer编译: +4. gpu版本powerinfer编译,如果你的机器有gpu,则可以运行以下命令: ```bash cmake -S . -B build -DLLAMA_CUBLAS=ON cmake --build build --config Release