Commit Graph

8 Commits

Author SHA1 Message Date
Junyang Lin
3e63f107fa Update finetune.py 2023-10-20 13:22:11 +08:00
梦典
f3d7c69be2 Update finetune.py
Just lora finetuing need low cpu memory usage
2023-10-18 15:24:45 +08:00
梦典
67b3f949b6 Update finetune.py For lower cpu memory
1.Change default device_map to "auto"
device_map = "auto"
2.For lower cpu memory, add parameter at load model
low_cpu_mem_usage=True,
2023-10-16 16:13:10 +08:00
Junyang Lin
00dceebbaa Update finetune.py 2023-10-09 01:11:24 +08:00
Junyang Lin
f7681f9e77 Update finetune.py 2023-10-07 18:47:29 +08:00
Junyang Lin
75cc160f74 Update finetune.py 2023-10-07 14:49:44 +08:00
JustinLin610
b5fad3d561 fix single-gpu qlora, and add profiling 2023-10-07 10:37:42 +08:00
JustinLin610
af22d5e0ce add finetuning 2023-09-11 23:47:32 +08:00