theluyuan/DiffSynth-Studio
1
0
Fork 0
mirror of https://github.com/modelscope/DiffSynth-Studio.git synced 2026-03-24 01:48:13 +00:00
Code Issues Packages Projects Releases Wiki Activity

hunyuanvideo text encoder

Browse Source
This commit is contained in:
root
2024-12-11 18:52:42 +08:00
parent 7c0520d029
commit 5d1005a7c8
13 changed files with 1351749 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

30
diffsynth/tokenizer_configs/hunyuan_video/tokenizer_2/special_tokens_map.json Normal file
View File

@@ -0,0 +1,30 @@
{
"bos_token": {
"content": "<|begin_of_text|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"eos_token": {
"content": "<|end_of_text|>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"pad_token": {
"content": "<pad>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
},
"unk_token": {
"content": "<unk>",
"lstrip": false,
"normalized": false,
"rstrip": false,
"single_word": false
}
}

1251020
diffsynth/tokenizer_configs/hunyuan_video/tokenizer_2/tokenizer.json Normal file
View File

File diff suppressed because it is too large Load Diff

2095
diffsynth/tokenizer_configs/hunyuan_video/tokenizer_2/tokenizer_config.json Normal file
View File

File diff suppressed because it is too large Load Diff