RYDE-WORK/ktransformers
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/ktransformers.git synced 2026-01-19 21:03:18 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity

Merge pull request #165 from kvcache-ai/KMSorSMS-patch-1

Browse Source 
Update FAQ.md
This commit is contained in:
ZiWei Yuan 2025-02-12 16:44:10 +08:00 committed by GitHub
commit 7e58f9d254
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 7 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
doc/en/FAQ.md
View File

@ -16,4 +16,10 @@ from-https://github.com/kvcache-ai/ktransformers/issues/117#issuecomment-2647542
So we fix this by manually adding "\<think>\n" token at prompt end (you can check out at local_chat.py),
and pass the arg `--force_think true ` can let the local_chat initiate the response with "\<think>\n"
from-https://github.com/kvcache-ai/ktransformers/issues/129#issue-2842799552
from-https://github.com/kvcache-ai/ktransformers/issues/129#issue-2842799552
### 3 version `GLIBCXX_3.4.30' not found
The detailed error:
>ImportError: /mnt/data/miniconda3/envs/xxx/bin/../lib/libstdc++.so.6: version `GLIBCXX_3.4.30' not found (required by /home/xxx/xxx/ktransformers/./cpuinfer_ext.cpython-312-x86_64-linux-gnu.so)
It may because of your conda env have no this version. Your can first exit your conda env by `conda deactivate` and use `whereis libstdc++.so.6` to find the path. And re enter your conda env and copy the .so by `cp <path of outter libstdc++> <path of your conda env libstdc++>`