RWKV-Runner/finetune/lora/v6/fla/ops/delta_rule
2024-05-28 22:35:47 +08:00
..
__init__.py sync https://github.com/JL-er/RWKV-PEFT 2024-05-28 22:35:47 +08:00
chunk_fuse.py sync https://github.com/JL-er/RWKV-PEFT 2024-05-28 22:35:47 +08:00
chunk.py sync https://github.com/JL-er/RWKV-PEFT 2024-05-28 22:35:47 +08:00
naive.py sync https://github.com/JL-er/RWKV-PEFT 2024-05-28 22:35:47 +08:00
README.md sync https://github.com/JL-er/RWKV-PEFT 2024-05-28 22:35:47 +08:00
recurrent_fuse.py sync https://github.com/JL-er/RWKV-PEFT 2024-05-28 22:35:47 +08:00
utils.py sync https://github.com/JL-er/RWKV-PEFT 2024-05-28 22:35:47 +08:00
wy_fast.py sync https://github.com/JL-er/RWKV-PEFT 2024-05-28 22:35:47 +08:00

  • Delta Rule

The implementation of delta rule described in https://arxiv.org/abs/2102.11174