2023-05-21 17:28:51 +08:00
|
|
|
|
<p align="center">
|
|
|
|
|
|
<img src="https://github.com/josStorer/RWKV-Runner/assets/13366013/d24834b0-265d-45f5-93c0-fac1e19562af">
|
|
|
|
|
|
</p>
|
|
|
|
|
|
|
|
|
|
|
|
<h1 align="center">RWKV Runner</h1>
|
|
|
|
|
|
|
|
|
|
|
|
<div align="center">
|
|
|
|
|
|
|
2023-05-22 11:48:56 +08:00
|
|
|
|
本项目旨在消除大语言模型的使用门槛，全自动为你处理一切，你只需要一个仅仅几MB的可执行程序。此外本项目提供了与OpenAI
|
|
|
|
|
|
API兼容的接口，这意味着一切ChatGPT客户端都是RWKV客户端。
|
2023-05-21 17:28:51 +08:00
|
|
|
|
|
|
|
|
|
|
[![license][license-image]][license-url]
|
|
|
|
|
|
[![release][release-image]][release-url]
|
|
|
|
|
|
|
|
|
|
|
|
[English](README.md) | 简体中文
|
|
|
|
|
|
|
2023-05-23 16:42:50 +08:00
|
|
|
|
[视频演示](https://www.bilibili.com/video/BV1hM4y1v76R) | [预览](#Preview) | [下载][download-url]
|
2023-05-21 17:28:51 +08:00
|
|
|
|
|
|
|
|
|
|
[license-image]: http://img.shields.io/badge/license-MIT-blue.svg
|
|
|
|
|
|
|
|
|
|
|
|
[license-url]: https://github.com/josStorer/RWKV-Runner/blob/master/LICENSE
|
|
|
|
|
|
|
|
|
|
|
|
[release-image]: https://img.shields.io/github/release/josStorer/RWKV-Runner.svg
|
|
|
|
|
|
|
|
|
|
|
|
[release-url]: https://github.com/josStorer/RWKV-Runner/releases/latest
|
|
|
|
|
|
|
2023-05-23 16:45:53 +08:00
|
|
|
|
[download-url]: https://github.com/josStorer/RWKV-Runner/releases/download/v1.0.2/RWKV-Runner_windows_x64.exe
|
2023-05-21 17:28:51 +08:00
|
|
|
|
|
|
|
|
|
|
</div>
|
|
|
|
|
|
|
2023-05-22 19:43:47 +08:00
|
|
|
|
#### 注意 目前RWKV中文模型质量一般，推荐使用英文模型体验实际RWKV能力
|
|
|
|
|
|
|
2023-05-23 20:52:18 +08:00
|
|
|
|
#### 预设配置没有开启自定义CUDA算子加速，但我强烈建议你开启它并使用int8量化运行，速度非常快，且显存消耗少得多。前往配置页面，打开`使用自定义CUDA算子加速`
|
|
|
|
|
|
|
2023-05-23 21:25:33 +08:00
|
|
|
|
#### 对于不同的任务，调整API参数会获得更好的效果，例如对于翻译任务，你可以尝试设置Temperature为1，Top_P为0.3
|
|
|
|
|
|
|
2023-05-21 17:28:51 +08:00
|
|
|
|
## 功能
|
|
|
|
|
|
|
|
|
|
|
|
- RWKV模型管理，一键启动
|
2023-05-22 11:48:56 +08:00
|
|
|
|
- 与OpenAI API完全兼容，一切ChatGPT客户端，都是RWKV客户端。启动模型后，打开 http://127.0.0.1:8000/docs 查看详细内容
|
2023-05-21 17:28:51 +08:00
|
|
|
|
- 全自动依赖安装，你只需要一个轻巧的可执行程序
|
|
|
|
|
|
- 自带用户友好的聊天交互页面
|
|
|
|
|
|
- 易于理解和操作的参数配置
|
|
|
|
|
|
- 内置模型转换工具
|
|
|
|
|
|
- 内置下载管理和远程模型检视
|
|
|
|
|
|
- 多语言本地化
|
|
|
|
|
|
- 主题切换
|
|
|
|
|
|
- 自动更新
|
|
|
|
|
|
|
|
|
|
|
|
## Todo
|
|
|
|
|
|
|
2023-05-23 14:58:45 +08:00
|
|
|
|
- [ ] 模型训练功能
|
|
|
|
|
|
- [x] CUDA算子int8提速
|
|
|
|
|
|
- [ ] macOS支持
|
|
|
|
|
|
- [ ] linux支持
|
2023-05-21 17:28:51 +08:00
|
|
|
|
|
|
|
|
|
|
## 相关仓库:
|
|
|
|
|
|
|
|
|
|
|
|
- RWKV-4-Raven: https://huggingface.co/BlinkDL/rwkv-4-raven/tree/main
|
|
|
|
|
|
- ChatRWKV: https://github.com/BlinkDL/ChatRWKV
|
|
|
|
|
|
- RWKV-LM: https://github.com/BlinkDL/RWKV-LM
|
|
|
|
|
|
|
|
|
|
|
|
## Preview
|
|
|
|
|
|
|
|
|
|
|
|
### 主页
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
### 聊天
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
### 配置
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
### 模型管理
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
### 下载管理
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
### 设置
|
|
|
|
|
|
|
|
|
|
|
|
|
