Commit Graph

53 Commits

Author SHA1 Message Date
josc146
d0fd480bd6 chore 2023-07-26 22:24:26 +08:00
josc146
77868c798b chore 2023-07-25 16:37:06 +08:00
josc146
f56748a941 improve python backend startup speed 2023-07-25 16:14:29 +08:00
josc146
29c5b1d804 add midi api 2023-07-25 16:11:17 +08:00
josc146
34095a6c36 support for stop array 2023-07-25 16:10:22 +08:00
josc146
05b9b42b56 add support for MIDI RWKV 2023-07-25 16:09:31 +08:00
josc146
9b3b06ab04 fix input with array type (#96, #107) 2023-07-17 12:59:45 +08:00
josc146
994fc7c828 fix cross-device state cache exception 2023-07-11 11:20:12 +08:00
josc146
f9f1d5c9fc improve /completions api compatibility 2023-07-10 20:45:08 +08:00
josc146
987854fe49 lora finetune (need to be refactored) 2023-07-03 17:41:47 +08:00
josc146
417389c5f6 improve for python3.8 3.9 2023-06-29 20:12:11 +08:00
josc146
43bc08648d update manifest 2023-06-20 16:07:52 +08:00
josc146
e93c77394d add usage 2023-06-20 15:55:52 +08:00
josc146
8963543159 embeddings api compatible with openai api and langchain(sdk) 2023-06-19 22:51:06 +08:00
josc146
377f71b16b type 2023-06-19 22:32:02 +08:00
josc146
d32351c130 exact model name 2023-06-19 22:30:49 +08:00
josc146
967be6f88f refactor completions api 2023-06-18 20:16:52 +08:00
josc146
721653a812 fix the state cache crash caused by bad prompts 2023-06-15 22:37:00 +08:00
josc146
21c3009945 improve api docs 2023-06-15 21:52:22 +08:00
josc146
5896593951 max_trie_len 2023-06-12 15:22:17 +08:00
josc146
8431b5d24f log Generation Prompt 2023-06-12 13:41:51 +08:00
josc146
bbd1ac1484 allow unloading model with switch-model 2023-06-12 12:34:03 +08:00
josc146
5990567a79 avoid misoperations of state_cache 2023-06-12 12:32:50 +08:00
josc146
fa0fcc2c89 add support for python3.8 3.9 2023-06-12 12:09:23 +08:00
josc146
cea1d8b4d1 add logs for state cache and switch-model 2023-06-09 20:46:19 +08:00
josc146
635767408f fix UnboundLocalError: local variable 'response' referenced before assignment 2023-06-08 13:30:34 +08:00
josc146
966b912013 improve logs 2023-06-03 19:28:37 +08:00
josc146
dc71054e61 improve logs 2023-06-03 17:36:50 +08:00
josc146
38b775c937 add logs 2023-06-03 17:12:59 +08:00
josc146
b41a2e7039 move state cache to memory (todo: state cache db) 2023-06-02 21:33:57 +08:00
josc146
b63370928d macOS 2023-06-01 16:54:21 +08:00
josc146
c8b2bb53ef improve system for rwkv-4-world 2023-05-31 12:46:06 +08:00
josc146
9945338458 chore 2023-05-30 11:52:33 +08:00
josc146
53b6a5ffe0 allow system to be placed anywhere 2023-05-29 22:26:22 +08:00
josc146
3e11128c9d feat: use model state cache to achieve 5x - 50x faster preparation time for generation 2023-05-28 23:52:38 +08:00
josc146
94971bb666 support for rwkv-4-world 2023-05-28 12:53:14 +08:00
josc146
b7fb8ed898 improve api concurrency performance 2023-05-27 15:18:12 +08:00
josc146
bcb38d991a add role: "system" support 2023-05-24 14:01:22 +08:00
josc146
c741b2a203 fix api completion_lock (#6) 2023-05-24 11:45:55 +08:00
josc146
1d08719645 update requirements and /status 2023-05-23 12:13:12 +08:00
josc146
524d9e78e6 SwitchModelBody.customCuda 2023-05-23 11:51:43 +08:00
josc146
375af3bc1a improve compatible API 2023-05-22 11:24:57 +08:00
josc146
85493da730 add compatible /v1/completions API 2023-05-22 11:18:37 +08:00
josc146
74ceffb32c fix completion_text 2023-05-21 23:25:58 +08:00
josc146
c3084a3290 fix py lock 2023-05-21 13:46:54 +08:00
josc146
7ba90ae7af detect status 2023-05-19 15:59:04 +08:00
josc146
1105fbf6ec chat page 2023-05-19 14:22:37 +08:00
josc146
934f7b15e8 i18n notifications and details 2023-05-18 21:19:13 +08:00
josc146
11813454de update 2023-05-17 11:47:45 +08:00
josc146
c947052574 preliminary usable features 2023-05-17 11:39:00 +08:00