josc146 511652b71c improve finetune compatibility

2023-07-03 22:19:20 +08:00

..

indexed_dataset.py

lora finetune (need to be refactored)

2023-07-03 17:41:47 +08:00

preprocess_data.py

improve finetune compatibility

2023-07-03 22:19:20 +08:00

rwkv_tokenizer.py

lora finetune (need to be refactored)

2023-07-03 17:41:47 +08:00

tokenizer.py

lora finetune (need to be refactored)

2023-07-03 17:41:47 +08:00