Update README.md

This commit is contained in:
Yang An
2023-08-04 22:05:01 +08:00
committed by GitHub
parent 34389ecdd6
commit b51856f613

View File

@@ -62,7 +62,7 @@ Before running the code, make sure you have setup the environment and installed
pip install transformers==4.31.0 accelerate tiktoken einops pip install transformers==4.31.0 accelerate tiktoken einops
``` ```
We recommend installing [flash-attention](https://github.com/Dao-AILab/flash-attention) for higher efficiency and lower memory usage. (**flash-attention is optional and the project can run normally without installing it**) If your device supports fp16 or bf16, we recommend installing [flash-attention](https://github.com/Dao-AILab/flash-attention) for higher efficiency and lower memory usage. (**flash-attention is optional and the project can run normally without installing it**)
```bash ```bash
git clone -b v1.0.8 https://github.com/Dao-AILab/flash-attention git clone -b v1.0.8 https://github.com/Dao-AILab/flash-attention