RYDE-WORK/ktransformers
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/ktransformers.git synced 2026-02-05 05:53:13 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge branch 'feat-DeepSeekV3' of github.com:kvcache-ai/ktransformers into feat-DeepSeekV3

Browse Source
This commit is contained in:
liam 2025-02-06 22:39:48 +08:00
commit 0262f954c7
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
ktransformers/local_chat.py
View File

@ -81,8 +81,10 @@ def local_chat():
content = "hi" content = "hi"
else: else:
content = open(config.prompt_file, "r").read() content = open(config.prompt_file, "r").read()
print("User: ", content)
elif os.path.isfile(content): elif os.path.isfile(content):
content = open(content, "r").read() content = open(content, "r").read()
print("User: ", content)
messages = his_content + [{"role": "user", "content": content}] messages = his_content + [{"role": "user", "content": content}]
async def async_inference(messages): async def async_inference(messages):