233 Commits

Author SHA1 Message Date
刘丹
3cab27b460 修改了awq的量化readme 2024-06-27 09:39:33 +08:00
刘丹
d58e892a98 增加了llama_facoty的微调示例 2024-06-27 09:04:43 +08:00
刘丹
c3206bad3f 增加了常用模块导航 2024-06-27 09:03:40 +08:00
LDLINGLINGLING
dc76234d43
Merge pull request #157 from LDLINGLINGLING/main
add support autoawq for minicpm
2024-06-25 12:04:55 +08:00
刘丹
e65930db1c 增加了readme中模型量化的导航以及示例 2024-06-25 11:50:53 +08:00
刘丹
e53c77c7e8 fix bug on quantize_eval.py 2024-06-25 11:38:18 +08:00
刘丹
2a86c6a287 增加了bash文件执行量化测试 2024-06-25 11:34:38 +08:00
刘丹
262840a805 修改了finetune中的默认模型的错误 2024-06-25 10:29:25 +08:00
刘丹
3347021a0c 增加了自定义数据集的量化方法 2024-06-25 10:24:17 +08:00
LDLINGLINGLING
4b6474aaa6
Merge branch 'OpenBMB:main' into main 2024-06-25 10:01:31 +08:00
LDLINGLINGLING
9d7e7ff2a8
Merge pull request #145 from LDLINGLINGLING/ollama_manual_installation
add ollama support minicpm-1b
2024-06-24 14:20:33 +08:00
LDLINGLINGLING
cfc31cd8ed
Merge branch 'OpenBMB:main' into main 2024-06-24 11:28:16 +08:00
root
5f239e3742 add wikitext dataset to quant 2024-06-24 11:26:07 +08:00
root
f062357093 add autoawq example 2024-06-24 10:57:19 +08:00
LDLINGLINGLING
ded03f75ed
Merge pull request #156 from LDLINGLINGLING/main
原始代码的usertoken是针对2b的,其他模型会有问题,现在根据不同模型都会调整
2024-06-24 10:26:35 +08:00
root
b808010417 注释前加了空格,保持代码规范性,刘丹 2024-06-21 16:19:01 +08:00
root
062ea5264a 使用encode方法,代码可读性更强 2024-06-21 16:08:39 +08:00
root
8ae10c60ff 原始代码的usertoken是针对2b的,其他模型会有问题,现在根据不同模型都会调整 2024-06-21 15:31:24 +08:00
LDLINGLINGLING
cf9a5be5be
Merge pull request #122 from zRzRzRzRzRzRzR/main
OpenAI API Support
2024-06-21 11:03:55 +08:00
刘丹
f68485d70e readme中增加了如何在minicpm中使用gptq 2024-06-06 15:11:43 +08:00
刘丹
5136ecb9fe add ollama support minicpm-1b 2024-06-05 18:05:24 +08:00
Chao Jia
cab7c75b56
Update MiniCPM Model License.md 2024-06-05 12:21:12 +08:00
Chao Jia
31284e6af5
Update MiniCPM模型商用许可协议.md 2024-06-05 12:20:23 +08:00
Chao Jia
b87a19b8da
Update MiniCPM模型商用许可协议.md 2024-06-05 12:12:51 +08:00
Chao Jia
5ade41f526
Update MiniCPM Model License.md 2024-06-05 12:11:47 +08:00
Chao Jia
fa02a1570d
Update MiniCPM模型商用许可协议.md 2024-06-05 11:58:30 +08:00
Chao Jia
5b999707c0
Update README-en.md 2024-06-05 10:46:04 +08:00
Chao Jia
45b1270078
Update README-en.md 2024-06-05 10:45:18 +08:00
Chao Jia
6ad727e739
Create MiniCPM Model License.md 2024-06-05 10:38:01 +08:00
Chao Jia
fe973cb89e
Update README.md 2024-06-05 10:28:51 +08:00
Chao Jia
ee9c2bbfc5
Update README.md 2024-06-05 10:26:34 +08:00
Chao Jia
fd7cc7c148
Create MiniCPM模型商用许可协议.md 2024-06-05 10:22:26 +08:00
zR
18efe83dbe
Merge branch 'OpenBMB:main' into main 2024-04-24 20:09:12 +08:00
Y.W. Fang
87ab91b572 update vllm dependency version 2024-04-24 19:05:34 +08:00
zR
3691af0fd2
Merge branch 'OpenBMB:main' into main 2024-04-24 18:42:13 +08:00
Zhi Zheng
ab6b2d4346
Merge pull request #106 from cyx2000/add_model_settings
fix: add fine-tuning model settings: bf16 and fp16 #92
2024-04-24 14:32:32 +08:00
SillyXu
74fbadea2e
Merge pull request #126 from hadoop2xu/ollama
fix ollama
2024-04-22 11:26:35 +08:00
zR
00c8059944
Merge branch 'OpenBMB:main' into main 2024-04-17 19:45:56 +08:00
xuhaifeng
fa7287db45 fix ollama 2024-04-17 18:23:16 +08:00
Y.W. Fang
0b24fbde4b fix minicpm-v repo path err 2024-04-15 19:35:15 +08:00
zR
3e7c74ec7a 128k模型无法推理的问题修复 2024-04-14 19:00:46 +08:00
zR
8272667430 更新VLLM的书写方式 2024-04-14 14:23:11 +08:00
zR
e58d99f8ca openai api需要的依赖,requirement推理依赖 2024-04-13 23:16:59 +08:00
zR
6981085d87
Merge branch 'OpenBMB:main' into main 2024-04-13 17:41:59 +08:00
DingDing
5e1c4ca6f8
Update README.md 2024-04-13 12:12:56 +08:00
zR
b9b53e2e19 OpenAI 推理简单应用
用的是Linux transformers载入推理的,只测试了常规对话,在跑的时候没有看到支持Function 功能就没写
2024-04-11 19:31:08 +08:00
zh-zheng
d6d1e4d330 update readme 2024-04-11 18:25:59 +08:00
zh-zheng
ed46d4671c update readme 2024-04-11 15:15:06 +08:00
Y.W. Fang
34ac3a2237 update readme and requirements about mlx 2024-04-11 14:22:03 +08:00
Y.W. Fang
dd0a03e503 fix typo 2024-04-11 13:51:06 +08:00