josc146 bbd1ac1484 allow unloading model with switch-model

2023-06-12 12:34:03 +08:00

..

routes

allow unloading model with switch-model

2023-06-12 12:34:03 +08:00

rwkv_pip

add support for python3.8 3.9

2023-06-12 12:09:23 +08:00

utils

add logs for state cache and switch-model

2023-06-09 20:46:19 +08:00

wkv_cuda_utils

fix cuda40 kernel

2023-05-25 00:22:09 +08:00

convert_model.py

update

2023-05-17 21:20:41 +08:00

dep_check.py

chore

2023-06-03 20:34:33 +08:00

get-pip.py

embed all core dependencies

2023-05-29 20:14:42 +08:00

global_var.py

detect status

2023-05-19 15:59:04 +08:00

main.py

add logs

2023-06-03 17:12:59 +08:00

requirements_versions.txt

add support for python3.8 3.9

2023-06-12 12:09:23 +08:00

requirements_without_cyac.txt

add requirements_without_cyac.txt

2023-06-05 22:58:56 +08:00

requirements.txt

feat: use model state cache to achieve 5x - 50x faster preparation time for generation

2023-05-28 23:52:38 +08:00