judy0131
|
890e444141
|
select nested dataframe
|
2018-10-17 14:34:22 +08:00 |
|
judy0131
|
0942318d80
|
print exception
|
2018-10-16 17:30:28 +08:00 |
|
judy0131
|
0639ee8716
|
1.fix find configurableStop in classpath bug
2.get all stop with groups
|
2018-10-16 17:27:02 +08:00 |
yanfqidong0604
|
c3b8f7d8b4
|
QiDong Yang
|
2018-10-16 16:35:45 +08:00 |
|
yanfqidong0604
|
bc0c097908
|
QiDong Yang
|
2018-10-16 14:30:54 +08:00 |
|
yanfqidong0604
|
2cab1d07d1
|
putEs,qurryEs(*),fetchEs(*)
|
2018-10-16 09:45:06 +08:00 |
|
judy0131
|
97aed5b250
|
add get all stops api
|
2018-10-15 12:42:25 +08:00 |
|
yanfqidong0604
|
67f64396a0
|
solr yang qi dong
|
2018-10-13 11:56:25 +08:00 |
|
yanfqidong0604
|
43ebe287ff
|
csv
yang qi dong
|
2018-10-13 11:53:10 +08:00 |
|
yanfqidong0604
|
7ba388f396
|
solr
yang qi dong
|
2018-10-13 11:31:49 +08:00 |
|
yanfqidong0604
|
13d321d689
|
solr
yang qi dong
|
2018-10-12 21:47:51 +08:00 |
|
judy0131
|
7b61f021dc
|
add stop description field
|
2018-10-12 15:27:09 +08:00 |
|
judy0131
|
7e05a0696e
|
add stop description field
|
2018-10-12 14:51:46 +08:00 |
|
judy0131
|
b9a4fec6cd
|
add stop description field
|
2018-10-12 14:51:22 +08:00 |
|
judy0131
|
a884c598eb
|
add json group ,script group and xml group's getPropertyDescriptor api
|
2018-10-12 14:35:45 +08:00 |
|
judy0131
|
058325d089
|
add hive group and jdbc group's getPropertyDescriptor api
|
2018-10-12 14:17:24 +08:00 |
|
judy0131
|
7ebaba5df2
|
add common group and csv group's getPropertyDescriptor api
|
2018-10-12 14:01:07 +08:00 |
xiaoxiao
|
8427853df0
|
add NaiveBayesPrediction stop
|
2018-10-11 10:39:50 +08:00 |
|
xiaoxiao
|
4b854b9a1e
|
add smoothing factor and model persistence for NaiveByesTraining Stop
|
2018-10-10 15:37:44 +08:00 |
|
xiaoxiao
|
763644cfda
|
Merge branch 'master' of https://github.com/cas-bigdatalab/piflow
|
2018-10-10 10:49:04 +08:00 |
|
xiaoxiao
|
9550f60d70
|
add NaiveBayesTraining Stop
|
2018-10-10 10:42:21 +08:00 |
|
judy0131
|
ab040dad25
|
add logs for application
|
2018-10-09 10:36:08 +08:00 |
|
judy0131
|
de2efc9a24
|
fix bug: getGroups api guava version conflict
|
2018-10-08 17:56:00 +08:00 |
|
judy0131
|
f374264dac
|
fix bug: getGroups(user defined stop must implement interface "getGroup")
|
2018-10-08 14:10:41 +08:00 |
|
judy0131
|
f2510a4285
|
set appname
|
2018-10-08 13:46:12 +08:00 |
|
judy0131
|
f577b6ad79
|
run application on yarn by SparkLauncher(Now checkpoint.path is fixed, we can not read this config in config.properties, because yarn will find config.properties in path /opt/hadoop-2.6.0/tmp/nm-local-dir/usercache/root/appcache/appId/containerId/conf/config.properties)
|
2018-10-08 13:26:00 +08:00 |
|
judy0131
|
8b5fb4e619
|
fix bug
|
2018-09-30 16:38:04 +08:00 |
|
judy0131
|
3ebd4e1758
|
Merge remote-tracking branch 'origin/master'
|
2018-09-29 18:03:32 +08:00 |
|
judy0131
|
b34dec8110
|
support multi sparkContext to run more than one flow at the same time(but only in standalone mode, yarn still have problems)
|
2018-09-29 18:03:18 +08:00 |
|
judy0131
|
1825eb07ff
|
support multi sparkContext to run more than one flow at the same time(but only in standalone mode, yarn still have problems)
|
2018-09-29 17:53:30 +08:00 |
|
xiaoxiao
|
a987093467
|
fix the bug with data consumption from kafka
|
2018-09-28 16:14:04 +08:00 |
|
xiaoxiao
|
1b63b70c4d
|
alter getGroup method and add authorEmail for stops
|
2018-09-28 13:31:27 +08:00 |
|
xiaoxiao
|
952f0cefea
|
add ftp group(LoadFromFtp and UploadToFtp)
|
2018-09-28 13:24:32 +08:00 |
|
xiaoxiao
|
97e2600fb8
|
fix a bug for ReadFromKafka Stop
|
2018-09-28 12:47:07 +08:00 |
|
xiaoxiao
|
caf919bae5
|
fix a bug
|
2018-09-28 10:50:37 +08:00 |
|
xiaoxiao
|
38cd7de567
|
fix a bug for ReadFromKafka stop
|
2018-09-28 10:40:57 +08:00 |
|
xiaoxiao
|
54b7a8509b
|
Merge branch 'master' of https://github.com/cas-bigdatalab/piflow
|
2018-09-27 12:23:48 +08:00 |
|
xiaoxiao
|
9fd6688dd7
|
add redis and kafka group
|
2018-09-27 12:20:07 +08:00 |
|
xiaoxiao
|
7ae7e6a888
|
add redis group(WriteToRedis and ReadFromRedis)
|
2018-09-27 12:16:24 +08:00 |
|
judy0131
|
dcd8777558
|
add bundle for getStopInfo
|
2018-09-27 11:31:24 +08:00 |
|
judy0131
|
6804e91a59
|
fix bug: can not find user defined Configurable Stop
|
2018-09-27 11:23:25 +08:00 |
|
judy0131
|
9102bf97bb
|
fix bug: can not find user defined Configurable Stop
|
2018-09-26 17:49:32 +08:00 |
|
judy0131
|
fd2ef07acd
|
add stop info api
|
2018-09-25 18:07:34 +08:00 |
|
judy0131
|
4c3385ea9f
|
add stop groups api
|
2018-09-25 17:35:11 +08:00 |
|
judy0131
|
e2b2df0418
|
1.modify ConfigurableStop getGroup api
2.modify findAllConfigurableStop
3.add findAllGroups
|
2018-09-25 16:31:55 +08:00 |
|
judy0131
|
08079e1985
|
add wait process terminate Runnable
|
2018-09-17 15:13:36 +08:00 |
|
judy0131
|
e6c4b22e5a
|
add stop's author
|
2018-09-17 14:10:51 +08:00 |
|
judy0131
|
c142c03529
|
add get stop properties api
|
2018-09-14 12:58:50 +08:00 |
|
judy0131
|
dd06ac6a43
|
add comment
|
2018-09-13 10:35:41 +08:00 |
|
judy0131
|
11a594d20c
|
add yarn.jars config to solve the problem -->"Neither spark.yarn.jars nor spark.yarn.archive is set, falling back to uploading libraries under SPARK_HOME",which makes the spark on yarn job run very slow!
|
2018-09-13 10:16:22 +08:00 |