From d075d6377e39fae6d5959d8609e8410969a64430 Mon Sep 17 00:00:00 2001 From: josc146 Date: Tue, 30 Apr 2024 23:05:51 +0800 Subject: [PATCH] release v1.7.9 --- CURRENT_CHANGE.md | 37 ++++++++++++++++++++++++++++++++++++- 1 file changed, 36 insertions(+), 1 deletion(-) diff --git a/CURRENT_CHANGE.md b/CURRENT_CHANGE.md index b48d745..4aa9d7b 100644 --- a/CURRENT_CHANGE.md +++ b/CURRENT_CHANGE.md @@ -1,6 +1,41 @@ ## Changes -- bump webgpu mode (https://github.com/Ai00-X/ai00_server) (#321) +- bump webgpu mode [ai00_server v0.4.2](https://github.com/Ai00-X/ai00_server) (huge performance improvement) +- upgrade to rwkv 0.8.26 (state-tuned model support) +- update defaultConfigs and manifest.json +- chores + +## Breaking Changes + +- change the default value of `presystem` to false + +For the convenience of using the future state-tuned models, the default value of `presystem` has been set to false. This +means that the RWKV-Runner service will no longer automatically insert recommended RWKV pre-prompts for you: + +``` +User: hi + +Assistant: Hi. I am your assistant and I will provide expert full response in full details. Please feel free to ask any question and I will always answer it. +``` + +If you are using the API service and conducting a rigorous RWKV conversation, please manually send the above messages to +the `/chat/completions` API's `messages` array, or manually send `presystem: true` to have the server automatically +insert pre-prompts. + +If you are using the RWKV-Runner client for chatting, you can enable `Insert default system prompt at the beginning` in +the preset editor. + +Of course, in reality, even if you do not perform the above, there is usually no significant negative impact. + +If you are using the new RWKV state-tuned models, you do not need to perform the above. + +The new RWKV state-tuned models can be downloaded here, they are very interesting: + +- https://huggingface.co/BlinkDL/rwkv-6-state-instruct-aligned +- https://huggingface.co/BlinkDL/temp-latest-training-models + +If you are interested in state-tuning, please refer +to: https://github.com/BlinkDL/RWKV-LM#state-tuning-tuning-the-initial-state-zero-inference-overhead ## Install