feat: use model state cache to achieve 5x - 50x faster preparation time for generation

This commit is contained in:
josc146
2023-05-28 23:52:38 +08:00
parent 822f2d729c
commit 3e11128c9d
7 changed files with 160 additions and 5 deletions