josc146 3e11128c9d feat: use model state cache to achieve 5x - 50x faster preparation time for generation

2023-05-28 23:52:38 +08:00

..

completion.py

support for rwkv-4-world

2023-05-28 12:53:14 +08:00

config.py

feat: use model state cache to achieve 5x - 50x faster preparation time for generation

2023-05-28 23:52:38 +08:00

state_cache.py

feat: use model state cache to achieve 5x - 50x faster preparation time for generation

2023-05-28 23:52:38 +08:00