Commit Graph

13 Commits

Author SHA1 Message Date
judy0131 416594d594 fix image bug 2018-10-19 14:37:17 +08:00
judy0131 ab040dad25 add logs for application 2018-10-09 10:36:08 +08:00
judy0131 f577b6ad79 run application on yarn by SparkLauncher(Now checkpoint.path is fixed, we can not read this config in config.properties, because yarn will find config.properties in path /opt/hadoop-2.6.0/tmp/nm-local-dir/usercache/root/appcache/appId/containerId/conf/config.properties) 2018-10-08 13:26:00 +08:00
judy0131 8b5fb4e619 fix bug 2018-09-30 16:38:04 +08:00
judy0131 1825eb07ff support multi sparkContext to run more than one flow at the same time(but only in standalone mode, yarn still have problems) 2018-09-29 17:53:30 +08:00
judy0131 11a594d20c add yarn.jars config to solve the problem -->"Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME",which makes the spark on yarn job run very slow! 2018-09-13 10:16:22 +08:00
judy0131 06f9a772dc remove core-site.xml hdfs-site.xml hive-site.xml yarn-site.xml 2018-09-11 14:51:24 +08:00
judy0131 60e4f3310e run on yarn 2018-09-10 15:26:51 +08:00
judy0131 da88183668 get flow info 2018-09-10 10:58:42 +08:00
judy0131 2ab05fccdd 1.modify piflow module,delete piflow-conf 2.deploy jar on server 2018-09-05 17:54:21 +08:00
judy0131 508f0639a9 rename piflow-api to piflow-server;add getFlowInfo Api 2018-09-04 09:53:19 +08:00
judy0131 c1b362bf02 modify akka version 2018-08-30 14:39:06 +08:00
judy0131 e5d9882eaa add startFlow & stopFlow Api 2018-08-23 17:16:28 +08:00