theluyuan/RWKV-Runner
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

send response even token is END_OF_TEXT

Browse Source
This commit is contained in:
josc146 2023-05-29 20:17:29 +08:00
parent 81d050d596
commit 142e30622e
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
backend-python/utils/rwkv.py
View File

@ -138,6 +138,7 @@ The following is a coherent verbose detailed conversation between a girl named {
) )
if token == END_OF_TEXT: if token == END_OF_TEXT:
yield response, ""
break break
if token not in occurrence: if token not in occurrence:
occurrence[token] = 1 occurrence[token] = 1