judy0131
|
416594d594
|
fix image bug
|
2018-10-19 14:37:17 +08:00 |
|
judy0131
|
ab040dad25
|
add logs for application
|
2018-10-09 10:36:08 +08:00 |
|
judy0131
|
f577b6ad79
|
run application on yarn by SparkLauncher(Now checkpoint.path is fixed, we can not read this config in config.properties, because yarn will find config.properties in path /opt/hadoop-2.6.0/tmp/nm-local-dir/usercache/root/appcache/appId/containerId/conf/config.properties)
|
2018-10-08 13:26:00 +08:00 |
|
judy0131
|
8b5fb4e619
|
fix bug
|
2018-09-30 16:38:04 +08:00 |
|
judy0131
|
1825eb07ff
|
support multi sparkContext to run more than one flow at the same time(but only in standalone mode, yarn still have problems)
|
2018-09-29 17:53:30 +08:00 |
|
judy0131
|
11a594d20c
|
add yarn.jars config to solve the problem -->"Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME",which makes the spark on yarn job run very slow!
|
2018-09-13 10:16:22 +08:00 |
|
judy0131
|
06f9a772dc
|
remove core-site.xml hdfs-site.xml hive-site.xml yarn-site.xml
|
2018-09-11 14:51:24 +08:00 |
|
judy0131
|
60e4f3310e
|
run on yarn
|
2018-09-10 15:26:51 +08:00 |
|
judy0131
|
da88183668
|
get flow info
|
2018-09-10 10:58:42 +08:00 |
|
judy0131
|
2ab05fccdd
|
1.modify piflow module,delete piflow-conf 2.deploy jar on server
|
2018-09-05 17:54:21 +08:00 |
|
judy0131
|
508f0639a9
|
rename piflow-api to piflow-server;add getFlowInfo Api
|
2018-09-04 09:53:19 +08:00 |
|
judy0131
|
c1b362bf02
|
modify akka version
|
2018-08-30 14:39:06 +08:00 |
|
judy0131
|
e5d9882eaa
|
add startFlow & stopFlow Api
|
2018-08-23 17:16:28 +08:00 |