5 Commits

Author	SHA1	Message	Date
josc146	5990567a79	avoid misoperations of state_cache	2023-06-12 12:32:50 +08:00
josc146	fa0fcc2c89	add support for python3.8 3.9	2023-06-12 12:09:23 +08:00
josc146	cea1d8b4d1	add logs for state cache and switch-model	2023-06-09 20:46:19 +08:00
josc146	b41a2e7039	move state cache to memory (todo: state cache db)	2023-06-02 21:33:57 +08:00
josc146	3e11128c9d	feat: use model state cache to achieve 5x - 50x faster preparation time for generation	2023-05-28 23:52:38 +08:00