RYDE-WORK/MiniCPM
1
0
Fork 0
mirror of https://github.com/RYDE-WORK/MiniCPM.git synced 2026-03-21 18:46:31 +08:00
Code Issues Actions Packages Projects Releases Wiki Activity
MiniCPM/inference/vllm/vllm/model_executor/parallel_utils
History
huangyuxiang03 4d32b410ff Add: vllm
2024-02-01 10:54:48 +08:00
..
__pycache__
Add: vllm
2024-02-01 10:54:48 +08:00
__init__.py
Add: vllm
2024-02-01 10:54:48 +08:00
communication_op.py
Add: vllm
2024-02-01 10:54:48 +08:00
parallel_state.py
Add: vllm
2024-02-01 10:54:48 +08:00
README.md
Add: vllm
2024-02-01 10:54:48 +08:00
utils.py
Add: vllm
2024-02-01 10:54:48 +08:00

README.md

The files in this folder are ported from Megatron-LM. We only keep the codes that are used in inference.