Commit Graph

2 Commits

Author SHA1 Message Date
chenfeiyu fbc7e51fc9 1. add compute_statistics and normalize;
2. use jsonlines to read and write metadata by default;
3. use threadpool to replace processpool in preprocessing cause it is faster.
2021-06-18 02:49:49 +00:00
chenfeiyu 58a988c789 add code to compute statistics 2021-06-16 16:18:13 +00:00