5 Commits

Author	SHA1	Message	Date
yangapku	e8e15962d8	add 72B and 1.8B Qwen models, add Ascend 910 and Hygon DCU support, add docker support	2023-11-30 15:29:13 +08:00
Junyang Lin	26922b81cb	Update finetune_qlora_ds.sh	2023-10-08 14:50:45 +08:00
JustinLin610	b5fad3d561	fix single-gpu qlora, and add profiling	2023-10-07 10:37:42 +08:00
JustinLin610	73f4040abb	add gradient checkpointing	2023-09-12 23:10:59 +08:00
JustinLin610	af22d5e0ce	add finetuning	2023-09-11 23:47:32 +08:00