RYDE-WORK/Langchain-Chatchat
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/Langchain-Chatchat.git synced 2026-02-07 07:23:29 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

add torch_gc to clear gpu cache in knowledge_based_chatglm.py

Browse Source
This commit is contained in:
littlepanda0716 2023-04-07 10:46:02 +08:00
parent 5664d1ff62
commit c4b52dda72
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
chatglm_llm.py
View File

@ -52,6 +52,7 @@ class ChatGLM(LLM):
max_length=self.max_token, max_length=self.max_token,
temperature=self.temperature, temperature=self.temperature,
) )
torch_gc()
print("history: ", self.history) print("history: ", self.history)
if stop is not None: if stop is not None:
response = enforce_stop_tokens(response, stop) response = enforce_stop_tokens(response, stop)