12 Commits

Author	SHA1	Message	Date
judy0131	ab040dad25	add logs for application	2018-10-09 10:36:08 +08:00
judy0131	f577b6ad79	run application on yarn by SparkLauncher(Now checkpoint.path is fixed, we can not read this config in config.properties, because yarn will find config.properties in path /opt/hadoop-2.6.0/tmp/nm-local-dir/usercache/root/appcache/appId/containerId/conf/config.properties)	2018-10-08 13:26:00 +08:00
judy0131	8b5fb4e619	fix bug	2018-09-30 16:38:04 +08:00
judy0131	1825eb07ff	support multi sparkContext to run more than one flow at the same time(but only in standalone mode, yarn still have problems)	2018-09-29 17:53:30 +08:00
judy0131	11a594d20c	add yarn.jars config to solve the problem -->"Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME",which makes the spark on yarn job run very slow!	2018-09-13 10:16:22 +08:00
judy0131	06f9a772dc	remove core-site.xml hdfs-site.xml hive-site.xml yarn-site.xml	2018-09-11 14:51:24 +08:00
judy0131	60e4f3310e	run on yarn	2018-09-10 15:26:51 +08:00
judy0131	da88183668	get flow info	2018-09-10 10:58:42 +08:00
judy0131	2ab05fccdd	1.modify piflow module,delete piflow-conf 2.deploy jar on server	2018-09-05 17:54:21 +08:00
judy0131	508f0639a9	rename piflow-api to piflow-server;add getFlowInfo Api	2018-09-04 09:53:19 +08:00
judy0131	c1b362bf02	modify akka version	2018-08-30 14:39:06 +08:00
judy0131	e5d9882eaa	add startFlow & stopFlow Api	2018-08-23 17:16:28 +08:00