starlight-apk/Qwen
1
0
Fork 0
mirror of https://github.com/QwenLM/Qwen.git synced 2026-05-20 16:35:47 +08:00
Code Issues Packages Projects Releases Wiki Activity

Update README.md

Browse Source
This commit is contained in:
Junyang Lin
2023-10-08 16:33:12 +08:00
committed by GitHub
parent 54189acc41
commit 12e4c8bda5
1 changed files with 2 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
README.md
View File

@@ -102,10 +102,8 @@ pip install -r requirements.txt
If your device supports fp16 or bf16, we recommend installing [flash-attention](https://github.com/Dao-AILab/flash-attention) (**we support flash attention 2 now.**) for higher efficiency and lower memory usage. (**flash-attention is optional and the project can run normally without installing it**) If your device supports fp16 or bf16, we recommend installing [flash-attention](https://github.com/Dao-AILab/flash-attention) (**we support flash attention 2 now.**) for higher efficiency and lower memory usage. (**flash-attention is optional and the project can run normally without installing it**)
```bash ```bash
# Previous installation commands. Now flash attention 2 is supported. git clone https://github.com/Dao-AILab/flash-attention
# git clone -b v1.0.8 https://github.com/Dao-AILab/flash-attention cd flash-attention && pip install .
# cd flash-attention && pip install .
pip install flash-attn --no-build-isolation
# Below are optional. Installing them might be slow. # Below are optional. Installing them might be slow.
# pip install csrc/layer_norm # pip install csrc/layer_norm
# pip install csrc/rotary # pip install csrc/rotary