josc146 81544ca8b3 rwkv5 lora finetune support (https://github.com/JL-er/RWKV-v5-lora)

2023-12-29 12:23:36 +08:00

..

data

update sample.jsonl

2023-10-26 14:08:16 +08:00

json2binidx_tool/tools

print error.txt

2023-11-08 22:57:38 +08:00

lora

rwkv5 lora finetune support (https://github.com/JL-er/RWKV-v5-lora)

2023-12-29 12:23:36 +08:00

get_layer_and_embd.py

rwkv5 lora finetune support (https://github.com/JL-er/RWKV-v5-lora)

2023-12-29 12:23:36 +08:00

install-wsl-dep-and-train.sh

rwkv5 lora finetune support (https://github.com/JL-er/RWKV-v5-lora)

2023-12-29 12:23:36 +08:00

requirements.txt

set deepspeed to 0.11.2 to avoid finetune error

2023-11-08 22:20:11 +08:00