josc146
|
d66fd89947
|
improve dynamic state api
|
2024-05-16 13:50:48 +08:00 |
|
josc146
|
a2bbbabee2
|
add support for dynamic state-tuned models
|
2024-05-12 21:51:24 +08:00 |
|
josc146
|
dd89041f72
|
dep_check.py now ignores GPUtil
|
2024-03-11 18:55:37 +08:00 |
|
josc146
|
a1ae71d221
|
fix /update-config can make the default value of unclearly specified fields invalid by passing in None fields
|
2024-02-05 22:27:02 +08:00 |
|
josc146
|
26b30f0dbe
|
add load failed traceback
|
2023-12-12 23:16:48 +08:00 |
|
josc146
|
b14fbc29b7
|
rwkv.cpp(ggml) support
|
2023-12-12 20:29:55 +08:00 |
|
josc146
|
d9e25ad69f
|
better state cache
|
2023-12-08 15:28:33 +08:00 |
|
josc146
|
dbf0dccc9d
|
add tokenizer(/switch-model) to /docs
|
2023-11-20 20:11:45 +08:00 |
|
josc146
|
7235e1067b
|
add deployment mode. If /switch-model with deploy: true, will disable /switch-model, /exit and other dangerous APIs (state cache APIs, part of midi APIs)
|
2023-11-08 23:29:42 +08:00 |
|
josc146
|
cfa3669f6f
|
fix /docs default api params (Pydantic v2)
|
2023-11-07 22:53:11 +08:00 |
|
josc146
|
627a20936d
|
RWKVType now no longer relies on the file name
|
2023-10-26 16:55:33 +08:00 |
|
josc146
|
46b3b285f5
|
upgrade packages
|
2023-10-25 17:07:40 +08:00 |
|
josc146
|
a25965530c
|
custom tokenizer (#77)
|
2023-09-16 00:34:11 +08:00 |
|
josc146
|
719090cc8c
|
improve python backend startup speed
|
2023-07-29 19:18:01 +08:00 |
|
josc146
|
d0fd480bd6
|
chore
|
2023-07-26 22:24:26 +08:00 |
|
josc146
|
05b9b42b56
|
add support for MIDI RWKV
|
2023-07-25 16:09:31 +08:00 |
|
josc146
|
994fc7c828
|
fix cross-device state cache exception
|
2023-07-11 11:20:12 +08:00 |
|
josc146
|
43bc08648d
|
update manifest
|
2023-06-20 16:07:52 +08:00 |
|
josc146
|
21c3009945
|
improve api docs
|
2023-06-15 21:52:22 +08:00 |
|
josc146
|
bbd1ac1484
|
allow unloading model with switch-model
|
2023-06-12 12:34:03 +08:00 |
|
josc146
|
cea1d8b4d1
|
add logs for state cache and switch-model
|
2023-06-09 20:46:19 +08:00 |
|
josc146
|
b63370928d
|
macOS
|
2023-06-01 16:54:21 +08:00 |
|
josc146
|
9945338458
|
chore
|
2023-05-30 11:52:33 +08:00 |
|
josc146
|
3e11128c9d
|
feat: use model state cache to achieve 5x - 50x faster preparation time for generation
|
2023-05-28 23:52:38 +08:00 |
|
josc146
|
94971bb666
|
support for rwkv-4-world
|
2023-05-28 12:53:14 +08:00 |
|
josc146
|
1d08719645
|
update requirements and /status
|
2023-05-23 12:13:12 +08:00 |
|
josc146
|
524d9e78e6
|
SwitchModelBody.customCuda
|
2023-05-23 11:51:43 +08:00 |
|
josc146
|
7ba90ae7af
|
detect status
|
2023-05-19 15:59:04 +08:00 |
|
josc146
|
934f7b15e8
|
i18n notifications and details
|
2023-05-18 21:19:13 +08:00 |
|
josc146
|
c947052574
|
preliminary usable features
|
2023-05-17 11:39:00 +08:00 |
|
josc146
|
9763de8f64
|
update
|
2023-05-07 22:48:52 +08:00 |
|
josc146
|
0e852daf43
|
backend api
|
2023-05-07 17:27:54 +08:00 |
|