Commit Graph

376 Commits

Author SHA1 Message Date
judy_0131 3b751243e8 1.fix csvparser bug
2.support python scprit
2020-03-04 16:01:11 +08:00
judy0131 ce9daf60a3 1.add python script executor
2. need to debug
2020-02-25 16:51:23 +08:00
judy0131 c0991b3cda optimize configure file
1.remove yarn related config
2.remove bundle path config
3.remove debug.path, checkpointPath and incrementPath config
2020-01-17 18:03:06 +08:00
judy_0131 2b9ab7ef42 Merge remote-tracking branch 'origin/master' 2020-01-16 17:01:48 +08:00
yanggang 9dd8b9b731 repair a bug ,Parameter contains ‘ } ’ , JSON file auto wrap, unable to parse .
annotating code: // flowJson = flowJson.replaceAll("}","}\n")
2020-01-16 16:35:39 +08:00
judy0131 e0de110462 1. fix JdbcWrite bug
2. update flyway sql script
2019-12-23 14:42:31 +08:00
judy0131 2a9229103f add h2db version control 2019-12-06 10:56:08 +08:00
dependabot[bot] efc946b17a
Bump netty-all from 4.0.42.Final to 4.1.42.Final in /piflow-bundle
Bumps [netty-all](https://github.com/netty/netty) from 4.0.42.Final to 4.1.42.Final.
- [Release notes](https://github.com/netty/netty/releases)
- [Commits](https://github.com/netty/netty/compare/netty-4.0.42.Final...netty-4.1.42.Final)

Signed-off-by: dependabot[bot] <support@github.com>
2019-11-02 05:39:45 +00:00
judy0131 fecb72a3e1 move nsfc stops to another project 2019-10-24 10:39:25 +08:00
judy0131 0698c7cbcd modify stop name 2019-10-23 17:17:21 +08:00
judy0131 d631ea7a2b fix bug 2019-09-18 18:40:44 +08:00
judy0131 d1dd9871c6 add info of Stop : whether user can add customized properties 2019-09-17 09:41:18 +08:00
or 7db0304b1d delete stop hbase 2019-09-16 18:05:31 +08:00
judy_0131 364fb825b8 Merge branch 'master' of https://github.com/cas-bigdatalab/piflow 2019-09-16 12:11:52 +08:00
or 3b64a5f174 fix bug NullPointException (ProcessXMLInAvro) 2019-09-12 17:57:41 +08:00
or 463f530a57 fix bug NullPointException (ProcessXMLInAvro) 2019-09-12 17:28:11 +08:00
or b0476d578f add nsfc stop (ProcessXMLInAvro) 2019-09-11 15:35:21 +08:00
judy0131 0f3ed0a357 add Route port 2019-09-10 18:10:23 +08:00
judy0131 f5b3c3eee2 1.add properties from DataFrame in piflow
2.implement route by customized Properties
2019-09-06 15:15:11 +08:00
or 049388a8e7 modification stop(Multiple fields can be parsed) 2019-09-05 15:41:22 +08:00
or bcb919f897
Update XmlParserWithJson.scala 2019-09-05 12:42:03 +08:00
or ba87ee0274 add stop(Parse xml fields) 2019-09-05 11:47:46 +08:00
or 007a8dd85a Release the code about readFromRedis 2019-09-04 15:00:39 +08:00
judy_0131 079635644c add filter stop 2019-09-03 18:17:49 +08:00
or 5ac2165f41
Update PutHiveStreaming.scala
update outport(None  -> DefaultPort)
2019-09-03 14:11:02 +08:00
or 488673a00c Add a component about Increase the column with uuid 2019-09-02 15:48:29 +08:00
or c58a82a215 update join stop 2019-09-02 10:50:55 +08:00
or 7572fe96bc add stop trager (Upstream and downstream middleware) 2019-08-30 16:34:11 +08:00
or c616c67516
Update ConvertSchemaType.scala
Change description information about ConvertSchemaType
2019-08-28 13:48:21 +08:00
SongDz c399533b91 clean bug 2019-08-28 13:42:17 +08:00
judy_0131 e51555ea60 Merge remote-tracking branch 'origin/master' 2019-08-28 11:22:39 +08:00
judy_0131 cc0ceafede add stop puthive 2019-08-28 11:21:15 +08:00
or 4ae001d316 Merge remote-tracking branch 'origin/master' 2019-08-27 16:00:33 +08:00
or f2ff12da3d change pom about ojdbc-11.2.0.3.jar, delete ojdbc5.jar and ojdbc6.jar 2019-08-27 15:54:59 +08:00
judy_0131 db5a7200d2 add stop from oracle to hive 2019-08-27 15:42:41 +08:00
or a62302c680 add ojdbc-11.2.0.3.jar( xmlType ) 2019-08-27 15:00:25 +08:00
or 5ed84aab89 add dropField stop,update executeSql stop 2019-08-27 10:20:20 +08:00
or d061684713
Update ConvertSchemaType.scala
ConvertSchemaType
2019-08-22 10:22:43 +08:00
or b624812503 Merge remote-tracking branch 'origin/master' 2019-08-20 15:38:20 +08:00
or 9f48d2384f Transform the schema dataType 2019-08-20 15:36:34 +08:00
or 89fb2fb5b0
Update ScopusSearchArticle.scala 2019-08-19 17:14:21 +08:00
judy0131 6873944e02 modify flow debug api 2019-08-15 14:26:41 +08:00
or 2e36dd9565
Update OracleRead.scala
fix a bug  about (ORA-00933: SQL command not properly ended)
2019-08-06 17:18:47 +08:00
or b855031fd8
Update ExecuteSQLStop.scala 2019-08-06 16:54:53 +08:00
or 207396b25a repair a bug where a title request has multiple results 2019-08-05 17:01:12 +08:00
or 8ec4bf848f repair a bug where a title request has multiple results 2019-08-05 16:29:26 +08:00
or f57d03d58a add nsfc scopus stop 2019-08-02 17:47:40 +08:00
judy0131 0ca125bae1 fix bug: piflow-web does not work when there are implemented functions in ConfigurableStop 2019-08-01 15:05:10 +08:00
coco11563 ec1680aadc Done distinct part 2019-07-31 19:45:45 +08:00
coco11563 99bbac29b4 bug fix
method implement
2019-07-31 16:30:57 +08:00