RWKV-Runner/finetune/lora/v6/fla/ops/delta_rule at 54f358c51c5e2e358bcdcb8db0c665bbdd1daff9 - RWKV-Runner - pplokijuhyg个人git站点

theluyuan/RWKV-Runner

Files

History

josc146 f05a4acb04 sync https://github.com/JL-er/RWKV-PEFT

2024-05-28 22:35:47 +08:00

..

__init__.py

sync https://github.com/JL-er/RWKV-PEFT

2024-05-28 22:35:47 +08:00

chunk_fuse.py

sync https://github.com/JL-er/RWKV-PEFT

2024-05-28 22:35:47 +08:00

chunk.py

sync https://github.com/JL-er/RWKV-PEFT

2024-05-28 22:35:47 +08:00

naive.py

sync https://github.com/JL-er/RWKV-PEFT

2024-05-28 22:35:47 +08:00

README.md

sync https://github.com/JL-er/RWKV-PEFT

2024-05-28 22:35:47 +08:00

recurrent_fuse.py

sync https://github.com/JL-er/RWKV-PEFT

2024-05-28 22:35:47 +08:00

utils.py

sync https://github.com/JL-er/RWKV-PEFT

2024-05-28 22:35:47 +08:00

wy_fast.py

sync https://github.com/JL-er/RWKV-PEFT

2024-05-28 22:35:47 +08:00

README.md

Delta Rule

The implementation of delta rule described in https://arxiv.org/abs/2102.11174