josc146
|
bb1a6191b0
|
prevent 'torch' has no attribute 'cuda' error in torch_gc, so user can use CPU or WebGPU (#302)
|
2024-03-11 19:04:19 +08:00 |
|
josc146
|
07d4ba0d6b
|
fix a generation exception caused by potentially dangerous regex being passed into the stop array
|
2024-03-04 21:20:53 +08:00 |
|
josc146
|
4f14074a75
|
expose global_penalty
|
2024-03-02 17:50:41 +08:00 |
|
josc146
|
53a5574080
|
improve parameters controllable range
|
2024-03-02 16:52:53 +08:00 |
|
josc146
|
e3baa0da86
|
improve occurrence[token] condition
|
2024-03-01 13:18:03 +08:00 |
|
josc146
|
b0f2ef65d9
|
improve occurrence[token] condition
|
2024-02-29 17:54:33 +08:00 |
|
josc146
|
18ab8b141f
|
disable AVOID_PENALTY_TOKENS
|
2024-02-28 23:12:58 +08:00 |
|
josc146
|
94fe71b49c
|
change AVOID_PENALTY to \n only
|
2024-02-22 01:04:05 +09:00 |
|
josc146
|
3e336830a3
|
chore
|
2024-02-06 12:19:12 +08:00 |
|
josc146
|
19eeeab1e1
|
add AVOID_PENALTY_TOKENS
|
2024-02-04 16:49:46 +08:00 |
|
josc146
|
843840baa0
|
expose penalty_decay, top_k
|
2024-02-03 22:03:10 +08:00 |
|
josc146
|
5f94d86558
|
add better custom tokenizer support and tokenizer-midipiano.json
|
2024-02-03 13:04:13 +08:00 |
|
josc146
|
947e127e34
|
improve path processing
|
2024-02-02 22:00:01 +08:00 |
|
josc146
|
16b636ef83
|
add EOS state cache point
|
2024-01-31 21:33:27 +08:00 |
|
josc146
|
16079a3cba
|
abc music inference support
|
2024-01-05 12:44:44 +08:00 |
|
josc146
|
7f3cfd54b0
|
improve state cache performance
|
2023-12-28 22:15:31 +08:00 |
|
josc146
|
e083f2c629
|
webgpu(python) state cache
|
2023-12-28 20:43:57 +08:00 |
|
josc146
|
f7494b0cfb
|
update midi_filter_config.json
|
2023-12-14 21:18:48 +08:00 |
|
josc146
|
0ddd2e9fea
|
add WebGPU Python Mode (https://github.com/cryscan/web-rwkv-py)
|
2023-12-14 18:37:07 +08:00 |
|
josc146
|
e0bf44d82f
|
bump MIDI-LLM-tokenizer (fix note off)
|
2023-12-14 13:33:27 +08:00 |
|
josc146
|
b14fbc29b7
|
rwkv.cpp(ggml) support
|
2023-12-12 20:29:55 +08:00 |
|
josc146
|
861e245062
|
RWKV_RESCALE_LAYER 999 for music model
|
2023-12-04 17:51:21 +08:00 |
|
josc146
|
cfa3669f6f
|
fix /docs default api params (Pydantic v2)
|
2023-11-07 22:53:11 +08:00 |
|
josc146
|
64826b9af7
|
fix log encoding error
|
2023-11-05 21:00:31 +08:00 |
|
josc146
|
47b0c35441
|
update ngrok_connect
|
2023-11-04 20:22:28 +08:00 |
|
josc146
|
43cfab5d4b
|
change default World series prefix to User/Assistant
|
2023-10-26 16:58:53 +08:00 |
|
josc146
|
627a20936d
|
RWKVType now no longer relies on the file name
|
2023-10-26 16:55:33 +08:00 |
|
josc146
|
46b3b285f5
|
upgrade packages
|
2023-10-25 17:07:40 +08:00 |
|
josc146
|
79851433f8
|
upgrade rwkv pip (0.8.13)
|
2023-10-03 13:33:55 +08:00 |
|
josc146
|
8a13bd3c1e
|
add rwkv-cuda-beta support (faster)
|
2023-08-14 22:07:15 +08:00 |
|
josc146
|
e0b7453883
|
allow multiple systems
|
2023-08-04 22:27:55 +08:00 |
|
josc146
|
8764c37b03
|
RWKVType
|
2023-07-31 22:46:13 +08:00 |
|
josc146
|
d12a173f39
|
global penalty
|
2023-07-31 22:02:28 +08:00 |
|
josc146
|
9d89b6f4db
|
fix params
|
2023-07-28 22:13:19 +08:00 |
|
josc146
|
d0fd480bd6
|
chore
|
2023-07-26 22:24:26 +08:00 |
|
josc146
|
1df345b5eb
|
improve embeddings API results
|
2023-07-25 20:30:43 +08:00 |
|
josc146
|
f56748a941
|
improve python backend startup speed
|
2023-07-25 16:14:29 +08:00 |
|
josc146
|
29c5b1d804
|
add midi api
|
2023-07-25 16:11:17 +08:00 |
|
josc146
|
34095a6c36
|
support for stop array
|
2023-07-25 16:10:22 +08:00 |
|
josc146
|
05b9b42b56
|
add support for MIDI RWKV
|
2023-07-25 16:09:31 +08:00 |
|
josc146
|
9ed3547738
|
rwkv pip 0.8.0
|
2023-06-28 19:36:15 +08:00 |
|
josc146
|
131a7ddf4a
|
fix the prompt cache that contains potential error
|
2023-06-21 16:07:16 +08:00 |
|
josc146
|
e93c77394d
|
add usage
|
2023-06-20 15:55:52 +08:00 |
|
josc146
|
8963543159
|
embeddings api compatible with openai api and langchain(sdk)
|
2023-06-19 22:51:06 +08:00 |
|
josc146
|
d32351c130
|
exact model name
|
2023-06-19 22:30:49 +08:00 |
|
josc146
|
967be6f88f
|
refactor completions api
|
2023-06-18 20:16:52 +08:00 |
|
josc146
|
21c3009945
|
improve api docs
|
2023-06-15 21:52:22 +08:00 |
|
josc146
|
714b8834c7
|
chore
|
2023-06-13 22:47:17 +08:00 |
|
josc146
|
8431b5d24f
|
log Generation Prompt
|
2023-06-12 13:41:51 +08:00 |
|
josc146
|
cea1d8b4d1
|
add logs for state cache and switch-model
|
2023-06-09 20:46:19 +08:00 |
|