yystopf
/
piflow
forked from opensci/piflow
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
587 Commits 16 Branches 0 Tags 88 MiB
Commit Graph

376 Commits

Author SHA1 Message Date
xiaoxiao 4b854b9a1e add smoothing factor and model persistence for NaiveByesTraining Stop 2018-10-10 15:37:44 +08:00
xiaoxiao 763644cfda Merge branch 'master' of https://github.com/cas-bigdatalab/piflow 2018-10-10 10:49:04 +08:00
xiaoxiao 9550f60d70 add NaiveBayesTraining Stop 2018-10-10 10:42:21 +08:00
judy0131 de2efc9a24 fix bug: getGroups api guava version conflict 2018-10-08 17:56:00 +08:00
judy0131 f577b6ad79 run application on yarn by SparkLauncher(Now checkpoint.path is fixed, we can not read this config in config.properties, because yarn will find config.properties in path /opt/hadoop-2.6.0/tmp/nm-local-dir/usercache/root/appcache/appId/containerId/conf/config.properties) 2018-10-08 13:26:00 +08:00
xiaoxiao a987093467 fix the bug with data consumption from kafka 2018-09-28 16:14:04 +08:00
xiaoxiao 1b63b70c4d alter getGroup method and add authorEmail for stops 2018-09-28 13:31:27 +08:00
xiaoxiao 952f0cefea add ftp group(LoadFromFtp and UploadToFtp) 2018-09-28 13:24:32 +08:00
xiaoxiao 97e2600fb8 fix a bug for ReadFromKafka Stop 2018-09-28 12:47:07 +08:00
xiaoxiao caf919bae5 fix a bug 2018-09-28 10:50:37 +08:00
xiaoxiao 38cd7de567 fix a bug for ReadFromKafka stop 2018-09-28 10:40:57 +08:00
xiaoxiao 54b7a8509b Merge branch 'master' of https://github.com/cas-bigdatalab/piflow 2018-09-27 12:23:48 +08:00
xiaoxiao 9fd6688dd7 add redis and kafka group 2018-09-27 12:20:07 +08:00
xiaoxiao 7ae7e6a888 add redis group(WriteToRedis and ReadFromRedis) 2018-09-27 12:16:24 +08:00
judy0131 dcd8777558 add bundle for getStopInfo 2018-09-27 11:31:24 +08:00
judy0131 6804e91a59 fix bug: can not find user defined Configurable Stop 2018-09-27 11:23:25 +08:00
judy0131 9102bf97bb fix bug: can not find user defined Configurable Stop 2018-09-26 17:49:32 +08:00
judy0131 fd2ef07acd add stop info api 2018-09-25 18:07:34 +08:00
judy0131 e2b2df0418 1.modify ConfigurableStop getGroup api 
2.modify findAllConfigurableStop
3.add findAllGroups
 2018-09-25 16:31:55 +08:00
judy0131 e6c4b22e5a add stop's author 2018-09-17 14:10:51 +08:00
judy0131 c142c03529 add get stop properties api 2018-09-14 12:58:50 +08:00
judy0131 66b3175ef7 fix bug 2018-09-11 17:13:05 +08:00
judy0131 ac8ad1a92e Merge branch 'master' of https://github.com/cas-bigdatalab/piflow 2018-09-11 14:53:54 +08:00
judy0131 06f9a772dc remove core-site.xml hdfs-site.xml hive-site.xml yarn-site.xml 2018-09-11 14:51:24 +08:00
xiaoxiao bb2ddc60d3 Merge branch 'master' of https://github.com/cas-bigdatalab/piflow 2018-09-11 14:24:50 +08:00
xiaoxiao 3732d0bcef add ftp group(LoadFromFtp and UploadToFtp) 2018-09-11 14:11:46 +08:00
judy0131 60e4f3310e run on yarn 2018-09-10 15:26:51 +08:00
judy0131 88471237ad fix bug: can not run flow when package code into piflow.jar 2018-09-06 17:09:35 +08:00
judy0131 2ab05fccdd 1.modify piflow module,delete piflow-conf 2.deploy jar on server 2018-09-05 17:54:21 +08:00
lj044500 e4d51735cc XmlTesst 2018-09-04 10:48:35 +08:00
lj044500 ed1c4e47fa add folder xml file dispose 2018-09-04 10:46:01 +08:00
lj044500 1250dee09f 文件夹中所有得.xml文件处理 2018-09-04 10:40:06 +08:00
judy0131 c347710084 fix bug 2018-09-03 14:50:55 +08:00
judy0131 6db6d54e56 add httpClient 2018-08-31 13:07:44 +08:00
xiaoxiao 14ba86908e 8.28 2018-08-28 11:39:22 +08:00
xiaoxiao 590cba100e Merge branch 'master' of https://github.com/cas-bigdatalab/piflow 2018-08-28 11:34:45 +08:00
xiaoxiao 7d7d4e53a8 8.28 2018-08-28 11:34:38 +08:00
xiaoxiao a8bf668aec 8.28 2018-08-28 11:33:46 +08:00
xiaoxiao ec0f29aaf4 8.28 2018-08-28 11:33:30 +08:00
xiaoxiao 7fcd3756db 8.27 2018-08-27 18:50:00 +08:00
xiaoxiao f0637eef9b 8.27 2018-08-27 18:49:42 +08:00
xiaoxiao 4025108491 8.27 2018-08-27 18:49:28 +08:00
xiaoxiao 5b3d2b79fc 8.27 2018-08-27 18:49:09 +08:00
judy0131 e5d9882eaa add startFlow & stopFlow Api 2018-08-23 17:16:28 +08:00
xiaoxiao bf7b5d9ea4 Merge branch 'master' of https://github.com/cas-bigdatalab/piflow 2018-08-23 13:36:17 +08:00
judy0131 221171e388 Merge branch 'master' of https://github.com/cas-bigdatalab/piflow 2018-08-23 13:13:18 +08:00
xiaoxiao 947b606abd 8.16 2018-08-17 11:24:30 +08:00
xiaoxiao e41c826592 8.15 2018-08-15 18:28:14 +08:00
xiaoxiao 235f4087c8 8.15 2018-08-15 16:35:39 +08:00
xiaoxiao 0a6b4190aa 8.14 2018-08-14 13:54:53 +08:00
xiaoxiao 873b8a5586 8.14 2018-08-14 13:54:43 +08:00
xiaoxiao 21b52578d6 8.13 2018-08-14 10:05:32 +08:00
xiaoxiao 35ab13085c 8.13 2018-08-13 17:08:15 +08:00
xiaoxiao 712fcbc0ec 8.13 2018-08-13 17:02:14 +08:00
xiaoxiao 6c82b4c452 8.13 2018-08-13 17:02:00 +08:00
xiaoxiao e7014c206d 8.13 2018-08-13 17:01:49 +08:00
xiaoxiao b2b23ddedf 8.10 2018-08-10 17:26:35 +08:00
xiaoxiao 0d7d203f71 8.10 2018-08-10 10:35:01 +08:00
xiaoxiao 3172e18a9a 8.10 2018-08-10 10:34:31 +08:00
xiaoxiao 3bc955bee8 8.10 2018-08-10 10:34:06 +08:00
xiaoxiao 65d73aa9cb 8.10 2018-08-10 10:33:46 +08:00
xiaoxiao 1b898fd827 8.10 2018-08-10 10:33:21 +08:00
judy0131 f6223baf68 add CsvSave 2018-08-02 17:24:47 +08:00
judy0131 a7a11bd5dc add findAllGroup api 2018-07-31 17:18:48 +08:00
judy0131 ddf12a0e67 add checkpoint 2018-07-31 14:16:56 +08:00
judy0131 20a9bdd42e add checkpoint 2018-07-31 14:15:02 +08:00
judy0131 67d09e945e add fork test 2018-07-31 10:22:18 +08:00
judy0131 898889ab6d add inportCount & outportCount 2018-07-20 16:56:24 +08:00
judy0131 309e14819d delete unuse code 2018-07-18 14:21:51 +08:00
judy0131 faf07b49a0 add DataFrameRowParser Stop for ShellExecutor 2018-07-18 14:04:50 +08:00
judy0131 576fbd039e add parameters for shell script 2018-07-18 10:13:51 +08:00
judy0131 2a2b6bd351 add ShellExecutor Stop 2018-07-17 17:47:46 +08:00
judy0131 8af62a6d5e add Stop Group 2018-07-17 15:23:14 +08:00
judy0131 9f743c3a12 modify Stop name 2018-07-17 14:43:34 +08:00
judy0131 9100fb9e26 add getIcon for ConfigurableStop 2018-07-16 17:18:40 +08:00
judy0131 1440871961 add piflow bundle module 2018-07-13 10:42:48 +08:00