2023-11-30 13:04:02 +08:00
|
|
|
## Changes
|
2023-06-09 21:16:37 +08:00
|
|
|
|
2024-03-01 16:03:22 +08:00
|
|
|
**This version includes important bug fixes, it is strongly recommended to upgrade to this version.**
|
|
|
|
|
|
2024-02-05 12:40:23 +08:00
|
|
|
### Upgrades
|
|
|
|
|
|
2024-03-01 16:03:22 +08:00
|
|
|
- webgpu 0.3.20 https://github.com/cgisky1980/ai00_rwkv_server
|
|
|
|
|
|
|
|
|
|
### Features
|
|
|
|
|
|
|
|
|
|
- allow setting quantizedLayers of WebGPU mode
|
|
|
|
|
|
|
|
|
|
### Improvements
|
|
|
|
|
|
|
|
|
|
- improve occurrence[token] condition
|
|
|
|
|
- disable AVOID_PENALTY_TOKENS when generating (still enabled when preprocessing)
|
|
|
|
|
- enable useHfMirror by default for chinese users
|
2024-02-05 12:40:23 +08:00
|
|
|
|
|
|
|
|
### Fixes
|
|
|
|
|
|
2024-03-01 16:03:22 +08:00
|
|
|
- fix the issue where state cache could be modified leading to inconsistent hit results
|
|
|
|
|
- fix convert_safetensors.py for rwkv6
|
|
|
|
|
- add python3-dev to lora fine-tune dependencies (this may previously lead to the error of v5 fine-tune)
|
2023-10-27 14:03:28 +08:00
|
|
|
|
2024-02-05 12:40:23 +08:00
|
|
|
### Chores
|
|
|
|
|
|
2024-03-01 16:03:22 +08:00
|
|
|
- hide MPS and CUDA-Beta Options
|
|
|
|
|
- update manifest
|
2024-02-05 12:40:23 +08:00
|
|
|
|
2023-06-09 21:16:37 +08:00
|
|
|
## Install
|
|
|
|
|
|
|
|
|
|
- Windows: https://github.com/josStorer/RWKV-Runner/blob/master/build/windows/Readme_Install.txt
|
|
|
|
|
- MacOS: https://github.com/josStorer/RWKV-Runner/blob/master/build/darwin/Readme_Install.txt
|
|
|
|
|
- Linux: https://github.com/josStorer/RWKV-Runner/blob/master/build/linux/Readme_Install.txt
|
2023-12-25 21:02:26 +08:00
|
|
|
- Simple Deploy Example: https://github.com/josStorer/RWKV-Runner/blob/master/README.md#simple-deploy-example
|
|
|
|
|
- Server Deploy Examples: https://github.com/josStorer/RWKV-Runner/tree/master/deploy-examples
|
