From 260b2d930f635a6b531f14bf452d58cb9b47beb8 Mon Sep 17 00:00:00 2001 From: DingDing Date: Fri, 2 Feb 2024 08:14:45 +0800 Subject: [PATCH] Update README.md --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 69a737b..2a73648 100644 --- a/README.md +++ b/README.md @@ -109,6 +109,7 @@ python inference.py --model_path --prompt_path prompts/promp ``` #### Huggingface 模型 +(注:我们发现当前Huggingface的推理代码推理效果差于Vllm的推理代码,我们正在对齐中,请耐心等待) ##### MiniCPM-2B * 安装`transformers>=4.36.0`以及`accelerate`后,运行以下代码 ```python