huangyuxiang03 4d32b410ff Add: vllm
2024-02-01 10:54:48 +08:00

9 lines
245 B
Markdown

# Benchmarking vLLM
## Downloading the ShareGPT dataset
You can download the dataset by running:
```bash
wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json
```