Commit Graph

25 Commits

Author SHA1 Message Date
josc146
dbf0dccc9d add tokenizer(/switch-model) to /docs 2023-11-20 20:11:45 +08:00
josc146
7235e1067b add deployment mode. If /switch-model with deploy: true, will disable /switch-model, /exit and other dangerous APIs (state cache APIs, part of midi APIs) 2023-11-08 23:29:42 +08:00
josc146
cfa3669f6f fix /docs default api params (Pydantic v2) 2023-11-07 22:53:11 +08:00
josc146
627a20936d RWKVType now no longer relies on the file name 2023-10-26 16:55:33 +08:00
josc146
46b3b285f5 upgrade packages 2023-10-25 17:07:40 +08:00
josc146
a25965530c custom tokenizer (#77) 2023-09-16 00:34:11 +08:00
josc146
719090cc8c improve python backend startup speed 2023-07-29 19:18:01 +08:00
josc146
d0fd480bd6 chore 2023-07-26 22:24:26 +08:00
josc146
05b9b42b56 add support for MIDI RWKV 2023-07-25 16:09:31 +08:00
josc146
994fc7c828 fix cross-device state cache exception 2023-07-11 11:20:12 +08:00
josc146
43bc08648d update manifest 2023-06-20 16:07:52 +08:00
josc146
21c3009945 improve api docs 2023-06-15 21:52:22 +08:00
josc146
bbd1ac1484 allow unloading model with switch-model 2023-06-12 12:34:03 +08:00
josc146
cea1d8b4d1 add logs for state cache and switch-model 2023-06-09 20:46:19 +08:00
josc146
b63370928d macOS 2023-06-01 16:54:21 +08:00
josc146
9945338458 chore 2023-05-30 11:52:33 +08:00
josc146
3e11128c9d feat: use model state cache to achieve 5x - 50x faster preparation time for generation 2023-05-28 23:52:38 +08:00
josc146
94971bb666 support for rwkv-4-world 2023-05-28 12:53:14 +08:00
josc146
1d08719645 update requirements and /status 2023-05-23 12:13:12 +08:00
josc146
524d9e78e6 SwitchModelBody.customCuda 2023-05-23 11:51:43 +08:00
josc146
7ba90ae7af detect status 2023-05-19 15:59:04 +08:00
josc146
934f7b15e8 i18n notifications and details 2023-05-18 21:19:13 +08:00
josc146
c947052574 preliminary usable features 2023-05-17 11:39:00 +08:00
josc146
9763de8f64 update 2023-05-07 22:48:52 +08:00
josc146
0e852daf43 backend api 2023-05-07 17:27:54 +08:00