Commit Graph

9 Commits

Author SHA1 Message Date
chenfeiyu fbc7e51fc9 1. add compute_statistics and normalize;
2. use jsonlines to read and write metadata by default;
3. use threadpool to replace processpool in preprocessing cause it is faster.
2021-06-18 02:49:49 +00:00
chenfeiyu 30045cf602 move synchronize up before timer starts 2021-06-17 03:12:35 +00:00
chenfeiyu 58a988c789 add code to compute statistics 2021-06-16 16:18:13 +00:00
chenfeiyu 042e02d242 use paddle's profiler 2021-06-16 13:43:13 +00:00
chenfeiyu 8dbcc9bccb add profiling 2021-06-16 09:40:47 +00:00
chenfeiyu bbbe5a8b50 add profiling 2021-06-16 14:47:30 +08:00
chenfeiyu 95f64c4f02 WIP: add some trainig info 2021-06-14 17:21:45 +08:00
chenfeiyu b0983e4d76 WIP: pwg training works 2021-06-14 17:05:37 +08:00
chenfeiyu 54c7905f40 WIP: training setup done 2021-06-13 17:24:15 +08:00