From c98f7d411afefd6f8a26a653379205f35393d415 Mon Sep 17 00:00:00 2001 From: =?UTF-8?q?=E5=88=98=E4=B8=B9?= Date: Thu, 27 Jun 2024 09:48:07 +0800 Subject: [PATCH] =?UTF-8?q?=E4=BF=AE=E6=94=B9=E4=BA=86awq=E7=9A=84?= =?UTF-8?q?=E9=87=8F=E5=8C=96readme?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/README.md b/README.md index 9ae2a4c..c5d8b96 100644 --- a/README.md +++ b/README.md @@ -312,7 +312,7 @@ print(model.response("<用户>山东省最高的山是哪座山, 它比黄山高 custom_data=[{'question':'过敏性鼻炎有什么症状?','answer':'过敏性鼻炎可能鼻塞,流鼻涕,头痛等症状反复发作,严重时建议及时就医。'}, {'question':'1+1等于多少?','answer':'等于2'}] ``` -4. 根据选择的数据集,修改quantize/awq_quantize.py 中第三十八行为以下三行代码其中一行: +4. 根据选择的数据集,选择以下某一行代码替换 quantize/awq_quantize.py 中第三十八行: ```python #使用wikitext进行量化 model.quantize(tokenizer, quant_config=quant_config, calib_data=load_wikitext(quant_data_path=quant_data_path))