josc146
|
fecdf238c1
|
feat: preload preset_system
|
2023-05-29 00:08:13 +08:00 |
|
josc146
|
3e11128c9d
|
feat: use model state cache to achieve 5x - 50x faster preparation time for generation
|
2023-05-28 23:52:38 +08:00 |
|
josc146
|
94971bb666
|
support for rwkv-4-world
|
2023-05-28 12:53:14 +08:00 |
|
josc146
|
06622b79aa
|
update rwkv_generate
|
2023-05-25 20:34:42 +08:00 |
|
josc146
|
524d9e78e6
|
SwitchModelBody.customCuda
|
2023-05-23 11:51:43 +08:00 |
|
josc146
|
7989e93afe
|
fixed torch version; CUDA acceleration utils
|
2023-05-23 11:19:39 +08:00 |
|
josc146
|
c947052574
|
preliminary usable features
|
2023-05-17 11:39:00 +08:00 |
|
josc146
|
83f0bb503c
|
update
|
2023-05-15 21:55:57 +08:00 |
|
josc146
|
0e852daf43
|
backend api
|
2023-05-07 17:27:54 +08:00 |
|