josc146
|
61cea2a784
|
add misc API (/models and /dashboard/billing/credit_grants)
|
2023-08-14 23:37:55 +08:00 |
|
josc146
|
da68926e9c
|
chore (AddStateBody class)
|
2023-08-13 21:27:29 +08:00 |
|
josc146
|
e0b7453883
|
allow multiple systems
|
2023-08-04 22:27:55 +08:00 |
|
josc146
|
91e2828a95
|
allow completions input to be null
|
2023-08-04 22:22:59 +08:00 |
|
josc146
|
b3e35a4cdd
|
allow custom user_name and assistant_name (/chat/completions API)
|
2023-07-31 22:48:54 +08:00 |
|
josc146
|
aecacde819
|
remove response field of completions api
|
2023-07-29 19:20:43 +08:00 |
|
josc146
|
3ef22239eb
|
improve default ChatCompletion stop
|
2023-07-29 19:19:38 +08:00 |
|
josc146
|
719090cc8c
|
improve python backend startup speed
|
2023-07-29 19:18:01 +08:00 |
|
josc146
|
9d89b6f4db
|
fix params
|
2023-07-28 22:13:19 +08:00 |
|
josc146
|
d0fd480bd6
|
chore
|
2023-07-26 22:24:26 +08:00 |
|
josc146
|
77868c798b
|
chore
|
2023-07-25 16:37:06 +08:00 |
|
josc146
|
f56748a941
|
improve python backend startup speed
|
2023-07-25 16:14:29 +08:00 |
|
josc146
|
29c5b1d804
|
add midi api
|
2023-07-25 16:11:17 +08:00 |
|
josc146
|
34095a6c36
|
support for stop array
|
2023-07-25 16:10:22 +08:00 |
|
josc146
|
05b9b42b56
|
add support for MIDI RWKV
|
2023-07-25 16:09:31 +08:00 |
|
josc146
|
9b3b06ab04
|
fix input with array type (#96, #107)
|
2023-07-17 12:59:45 +08:00 |
|
josc146
|
994fc7c828
|
fix cross-device state cache exception
|
2023-07-11 11:20:12 +08:00 |
|
josc146
|
f9f1d5c9fc
|
improve /completions api compatibility
|
2023-07-10 20:45:08 +08:00 |
|
josc146
|
987854fe49
|
lora finetune (need to be refactored)
|
2023-07-03 17:41:47 +08:00 |
|
josc146
|
417389c5f6
|
improve for python3.8 3.9
|
2023-06-29 20:12:11 +08:00 |
|
josc146
|
43bc08648d
|
update manifest
|
2023-06-20 16:07:52 +08:00 |
|
josc146
|
e93c77394d
|
add usage
|
2023-06-20 15:55:52 +08:00 |
|
josc146
|
8963543159
|
embeddings api compatible with openai api and langchain(sdk)
|
2023-06-19 22:51:06 +08:00 |
|
josc146
|
377f71b16b
|
type
|
2023-06-19 22:32:02 +08:00 |
|
josc146
|
d32351c130
|
exact model name
|
2023-06-19 22:30:49 +08:00 |
|
josc146
|
967be6f88f
|
refactor completions api
|
2023-06-18 20:16:52 +08:00 |
|
josc146
|
721653a812
|
fix the state cache crash caused by bad prompts
|
2023-06-15 22:37:00 +08:00 |
|
josc146
|
21c3009945
|
improve api docs
|
2023-06-15 21:52:22 +08:00 |
|
josc146
|
5896593951
|
max_trie_len
|
2023-06-12 15:22:17 +08:00 |
|
josc146
|
8431b5d24f
|
log Generation Prompt
|
2023-06-12 13:41:51 +08:00 |
|
josc146
|
bbd1ac1484
|
allow unloading model with switch-model
|
2023-06-12 12:34:03 +08:00 |
|
josc146
|
5990567a79
|
avoid misoperations of state_cache
|
2023-06-12 12:32:50 +08:00 |
|
josc146
|
fa0fcc2c89
|
add support for python3.8 3.9
|
2023-06-12 12:09:23 +08:00 |
|
josc146
|
cea1d8b4d1
|
add logs for state cache and switch-model
|
2023-06-09 20:46:19 +08:00 |
|
josc146
|
635767408f
|
fix UnboundLocalError: local variable 'response' referenced before assignment
|
2023-06-08 13:30:34 +08:00 |
|
josc146
|
966b912013
|
improve logs
|
2023-06-03 19:28:37 +08:00 |
|
josc146
|
dc71054e61
|
improve logs
|
2023-06-03 17:36:50 +08:00 |
|
josc146
|
38b775c937
|
add logs
|
2023-06-03 17:12:59 +08:00 |
|
josc146
|
b41a2e7039
|
move state cache to memory (todo: state cache db)
|
2023-06-02 21:33:57 +08:00 |
|
josc146
|
b63370928d
|
macOS
|
2023-06-01 16:54:21 +08:00 |
|
josc146
|
c8b2bb53ef
|
improve system for rwkv-4-world
|
2023-05-31 12:46:06 +08:00 |
|
josc146
|
9945338458
|
chore
|
2023-05-30 11:52:33 +08:00 |
|
josc146
|
53b6a5ffe0
|
allow system to be placed anywhere
|
2023-05-29 22:26:22 +08:00 |
|
josc146
|
3e11128c9d
|
feat: use model state cache to achieve 5x - 50x faster preparation time for generation
|
2023-05-28 23:52:38 +08:00 |
|
josc146
|
94971bb666
|
support for rwkv-4-world
|
2023-05-28 12:53:14 +08:00 |
|
josc146
|
b7fb8ed898
|
improve api concurrency performance
|
2023-05-27 15:18:12 +08:00 |
|
josc146
|
bcb38d991a
|
add role: "system" support
|
2023-05-24 14:01:22 +08:00 |
|
josc146
|
c741b2a203
|
fix api completion_lock (#6)
|
2023-05-24 11:45:55 +08:00 |
|
josc146
|
1d08719645
|
update requirements and /status
|
2023-05-23 12:13:12 +08:00 |
|
josc146
|
524d9e78e6
|
SwitchModelBody.customCuda
|
2023-05-23 11:51:43 +08:00 |
|