From 2bf9e80bf8ffdd10160a878f34abf32eec1dac30 Mon Sep 17 00:00:00 2001 From: DingDing Date: Fri, 2 Feb 2024 16:54:13 +0800 Subject: [PATCH] Update README.md --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 928c564..d914982 100644 --- a/README.md +++ b/README.md @@ -109,7 +109,7 @@ python inference.py --model_path --prompt_path prompts/promp ``` #### Huggingface 模型 -(注:我们发现当前Huggingface的推理代码推理效果差于Vllm的推理代码,我们正在对齐中,请耐心等待) +(注:我们发现当前Huggingface的推理代码推理效果差于Vllm的推理代码,我们正在对齐中,目前已定为到PageAttention和普通attention的区别,请耐心等待) ##### MiniCPM-2B * 安装`transformers>=4.36.0`以及`accelerate`后,运行以下代码 ```python