Commit Graph

4 Commits

Author SHA1 Message Date
TianYuan c497fd843d format 2021-08-17 09:54:07 +00:00
chenfeiyu 3ebed00c96 minor fixes to refine code. 2021-07-01 16:14:55 +08:00
chenfeiyu fbc7e51fc9 1. add compute_statistics and normalize;
2. use jsonlines to read and write metadata by default;
3. use threadpool to replace processpool in preprocessing cause it is faster.
2021-06-18 02:49:49 +00:00
chenfeiyu 58a988c789 add code to compute statistics 2021-06-16 16:18:13 +00:00