733 Commits

Author SHA1 Message Date
liunux4odoo
a1a7484ef4 增加webui_utils.py,包括制作webui通用的工具,方便以后开发其他webui 2023-08-01 14:15:42 +08:00
imClumsyPanda
9f4567865c add chatglm2-6b-32k and make m3e default embedding model 2023-08-01 14:12:28 +08:00
liunux4odoo
9e2b411b01 cuda error with multiprocessing, change model_worker to main process 2023-07-31 11:18:57 +08:00
hzg0601
47dfb6cd8b udpate llm_api 2023-07-31 11:00:33 +08:00
liunux4odoo
946f10e1f2 split api_start to create_app & run_api. user can run api with uvicorn in console: uvicorn server.api:app --port 7861 2023-07-31 10:05:19 +08:00
liunux4odoo
463659f0ba llm_api升级到fschat==0.2.20,支持百川模型 2023-07-30 23:16:47 +08:00
liunux4odoo
51ea717606 Merge branch 'dev_fastchat_me' into dev_fastchat 2023-07-30 09:01:31 +08:00
liunux4odoo
179c2a9a92 修改server.chat.openai_chat中的参数定义,使其与openai中/v1/chat/completions接口的入参保持一致,并按照model_config提供默认值。
openai_chat中的接口还要修改:openai根据参数stream有不同的返回值,本接口要与其对应。
2023-07-30 08:56:49 +08:00
imClumsyPanda
05ccc0346e update test code 2023-07-30 00:48:07 +08:00
imClumsyPanda
41444fd4b5 update requirements.txt and llm_api.py 2023-07-30 00:24:34 +08:00
imClumsyPanda
d4ffc70d96 update requirements.txt 2023-07-29 23:46:02 +08:00
liunux4odoo
1a7271e966 fix: model_worker need global variable: args 2023-07-29 23:22:25 +08:00
liunux4odoo
c880412300 use multiprocessing to run fastchat server 2023-07-29 23:01:24 +08:00
liunux4odoo
829ced398b make api.py import model_config coreectlly 2023-07-29 23:00:50 +08:00
liunux4odoo
8b1cf7effd fix: os.environ['OPENAI_API_KEY'] exception when no environment variable set 2023-07-28 16:51:58 +08:00
liunux4odoo
70c6870776 增加api_one.py,把fastchat
3个服务端整合在一起。后面考虑把api.py也整合进来。
3个进程变成1个进程可能带来少许性能损失,但对于个人用户降低了部署难度。
2023-07-28 16:41:45 +08:00
hzg0601
97ee4686a1 更新会议记录 2023-07-28 16:16:59 +08:00
hzg0601
154cad1b45 会议记录 2023-07-28 16:12:57 +08:00
imClumsyPanda
e95996a9b9 update requirements.txt 2023-07-28 06:59:16 +08:00
imClumsyPanda
59442dcd4a update webui.py 2023-07-28 06:58:34 +08:00
imClumsyPanda
dd0f90b4a4 readd .github 2023-07-28 06:54:54 +08:00
imClumsyPanda
620ccb3bdc update model_config.py 2023-07-27 23:28:33 +08:00
imClumsyPanda
dcf49a59ef v0.2.0 first commit 2023-07-27 23:22:07 +08:00
imClumsyPanda
f7a32f9248
Update README.md 2023-07-27 09:23:31 +08:00
imClumsyPanda
36a1c72573
Add files via upload 2023-07-27 09:23:07 +08:00
imClumsyPanda
01a54d1042 add chatglm-fitness-RLHF made by @BoFan-tunning to llm_model_dict in model_config.py 2023-07-26 21:41:27 +08:00
imClumsyPanda
0a062ba07b update img 2023-07-26 21:37:22 +08:00
imClumsyPanda
db80358df8
Update model_config.py
fix openai api url
2023-07-25 11:16:02 +08:00
imClumsyPanda
3f627af745
Update README.md 2023-07-24 08:32:21 +08:00
imClumsyPanda
b586ee6e1f
Add files via upload 2023-07-24 08:31:54 +08:00
imClumsyPanda
fdd353e48a Merge branch 'master' into dev 2023-07-23 18:40:04 +08:00
imClumsyPanda
ff5d2ecc1e update img 2023-07-23 18:39:49 +08:00
imClumsyPanda
0f43845a98 merge master 2023-07-23 18:38:51 +08:00
hzg0601
1e1075b98a Merge branch 'dev' of github.com:imClumsyPanda/langchain-ChatGLM into dev 2023-07-21 23:13:11 +08:00
hzg0601
b2278f2f25 更改api.py的chat函数的history的类型为Optional,修复chat接口不可调用的问题 2023-07-21 23:12:28 +08:00
liunux4odoo
a6f42e7c8e fix iss#889:
when init_model on startup, set llm model's history_len to LLM_HISTORY_LEN from model_config.
2023-07-21 23:07:50 +08:00
Ma Zhiming
3f76cb5f47
[Fix] INSTALL.md (#907)
* Update INSTALL.md

* Update INSTALL.md
2023-07-21 16:42:53 +08:00
hzg0601
3b6819f091 更改默认的LLM_MODEL 2023-07-21 15:35:17 +08:00
hzg0601
6ec1e56e03 Merge branch 'dev' of github.com:imClumsyPanda/langchain-ChatGLM into dev 2023-07-21 15:29:53 +08:00
Zhi-guo Huang
acee2d5ad2
Merge pull request #905 from chinainfant/dev
解决加载ptuning检查点失败的问题
2023-07-21 15:32:37 +08:00
chinainfant
c1c2ed1943
Update loader.py 解决加载ptuning报错的问题 2023-07-21 15:30:19 +08:00
hzg0601
32122ee225 update gitignore 2023-07-21 15:29:36 +08:00
chinainfant
ec2bf9757c
Update args.py 将use-ptuning-v2的命名行改为action='store_true' 2023-07-21 15:28:11 +08:00
Zhi-guo Huang
7d37dc876e
Merge pull request #904 from bones-zhu/dev
1 修复model_config.py的type;2 修改默认的LLM_model;3. 移除chatglm_llm.py的无用模块
2023-07-21 15:14:33 +08:00
bones-zhu
5479a74789
Update chatglm_llm.py remove unused library 2023-07-21 15:11:51 +08:00
bones-zhu
e2eaefc999
Update model_config.py 修改默认的LLM_MODEL 2023-07-21 15:10:13 +08:00
bones-zhu
a1b454fc43
Update model_config.py fix type 2023-07-21 15:09:33 +08:00
hzg0601
5f4f8dcedc 解决loader.py中以名称匹配模型式未排除chatglm2的问题 2023-07-21 09:49:18 +08:00
hzg0601
a5294748a4 Merge branch 'dev' of github.com:imClumsyPanda/langchain-ChatGLM into dev 2023-07-21 09:32:19 +08:00
hzg0601
915f4f359a 补充openai的连接失败问题解决方案 2023-07-21 09:29:43 +08:00