starlight-apk/Qwen
1
0
Fork 0
mirror of https://github.com/QwenLM/Qwen.git synced 2026-05-20 16:35:47 +08:00
Code Issues Packages Projects Releases Wiki Activity

Update finetune_lora_single_gpu.sh

Browse Source
This commit is contained in:
Junyang Lin
2023-10-09 01:13:08 +08:00
committed by GitHub
parent 00dceebbaa
commit 343017c4ce
1 changed files with 3 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
finetune/finetune_lora_single_gpu.sh
View File

@@ -34,3 +34,6 @@ python finetune.py \
--lazy_preprocess True \ --lazy_preprocess True \
--gradient_checkpointing \ --gradient_checkpointing \
--use_lora --use_lora
# If you use fp16 instead of bf16, you should use deepspeed
# --fp16 True --deepspeed finetune/ds_config_zero2.json