Go to file
judy0131 f577b6ad79 run application on yarn by SparkLauncher(Now checkpoint.path is fixed, we can not read this config in config.properties, because yarn will find config.properties in path /opt/hadoop-2.6.0/tmp/nm-local-dir/usercache/root/appcache/appId/containerId/conf/config.properties) 2018-10-08 13:26:00 +08:00
classpath fix bug: can not find user defined Configurable Stop 2018-09-26 17:49:32 +08:00
conf run application on yarn by SparkLauncher(Now checkpoint.path is fixed, we can not read this config in config.properties, because yarn will find config.properties in path /opt/hadoop-2.6.0/tmp/nm-local-dir/usercache/root/appcache/appId/containerId/conf/config.properties) 2018-10-08 13:26:00 +08:00
piflow-bundle run application on yarn by SparkLauncher(Now checkpoint.path is fixed, we can not read this config in config.properties, because yarn will find config.properties in path /opt/hadoop-2.6.0/tmp/nm-local-dir/usercache/root/appcache/appId/containerId/conf/config.properties) 2018-10-08 13:26:00 +08:00
piflow-core 1.modify piflow module,delete piflow-conf 2.deploy jar on server 2018-09-05 17:54:21 +08:00
piflow-server run application on yarn by SparkLauncher(Now checkpoint.path is fixed, we can not read this config in config.properties, because yarn will find config.properties in path /opt/hadoop-2.6.0/tmp/nm-local-dir/usercache/root/appcache/appId/containerId/conf/config.properties) 2018-10-08 13:26:00 +08:00
testdata context.scala 2018-05-29 10:52:38 +08:00
.gitignore create conf module 2018-06-26 10:31:57 +08:00
LICENSE init 2018-05-03 18:15:05 +08:00
README.md Update README.md 2018-05-03 18:14:12 +08:00
piflow-project.iml create conf module 2018-06-26 10:31:57 +08:00
pom.xml 1.modify ConfigurableStop getGroup api 2018-09-25 16:31:55 +08:00
readMe.txt add comment 2018-09-13 10:35:41 +08:00

README.md

piflow

spark work flow:

  • no compile job code
  • XML defines regular jobs
  • SQL