starlight-apk/Qwen
1
0
Fork 0
mirror of https://github.com/QwenLM/Qwen.git synced 2026-05-20 16:35:47 +08:00
Code Issues Packages Projects Releases Wiki Activity

Update README_CN.md

Browse Source
This commit is contained in:
Junyang Lin
2023-10-20 22:04:43 +08:00
committed by GitHub
parent d082c2c926
commit 8effcb2a76
1 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README_CN.md
View File

@@ -667,7 +667,8 @@ merged_model.save_pretrained(new_model_directory, max_shard_size="2048MB", safe_
### vLLM ### vLLM
如希望部署及加速推理，我们建议你使用vLLM和FastChat。首先安装相应的代码库： 如希望部署及加速推理，我们建议你使用vLLM和FastChat。首先安装相应的代码库：
```bash ```bash
pip install vllm fastchat pip install vllm
pip install "fschat[model_worker,webui]"
``` ```
你也可以通过`git clone`和`pip install -e .`的方式通过源码安装。如果遇到安装问题，请阅读它们的官方文档。 你也可以通过`git clone`和`pip install -e .`的方式通过源码安装。如果遇到安装问题，请阅读它们的官方文档。