josc146 b41a2e7039 move state cache to memory (todo: state cache db)

2023-06-02 21:33:57 +08:00

..

routes

move state cache to memory (todo: state cache db)

2023-06-02 21:33:57 +08:00

rwkv_pip

embed all core dependencies

2023-05-29 20:14:42 +08:00

utils

fix_tokens

2023-05-31 16:07:09 +08:00

wkv_cuda_utils

fix cuda40 kernel

2023-05-25 00:22:09 +08:00

convert_model.py

update

2023-05-17 21:20:41 +08:00

dep_check.py

macOS

2023-06-01 16:54:21 +08:00

get-pip.py

embed all core dependencies

2023-05-29 20:14:42 +08:00

global_var.py

detect status

2023-05-19 15:59:04 +08:00

main.py

feat: use model state cache to achieve 5x - 50x faster preparation time for generation

2023-05-28 23:52:38 +08:00

requirements_versions.txt

feat: use model state cache to achieve 5x - 50x faster preparation time for generation

2023-05-28 23:52:38 +08:00

requirements.txt

feat: use model state cache to achieve 5x - 50x faster preparation time for generation

2023-05-28 23:52:38 +08:00