Commit Graph

501 Commits

Author SHA1 Message Date
judy_0131 db5a7200d2 add stop from oracle to hive 2019-08-27 15:42:41 +08:00
judy_0131 f599d6e36d fix bug: sparklauncher launch executor number error 2019-08-27 15:38:03 +08:00
or a62302c680 add ojdbc-11.2.0.3.jar( xmlType ) 2019-08-27 15:00:25 +08:00
or 5ed84aab89 add dropField stop,update executeSql stop 2019-08-27 10:20:20 +08:00
judy0131 afbcbabcaa modify piflow bin shell script 2019-08-22 17:39:33 +08:00
judy0131 c095c6aaff Merge remote-tracking branch 'origin/master' 2019-08-22 11:21:35 +08:00
judy0131 a1c61ee99b fix bug 2019-08-22 11:21:20 +08:00
or d061684713
Update ConvertSchemaType.scala
ConvertSchemaType
2019-08-22 10:22:43 +08:00
or b624812503 Merge remote-tracking branch 'origin/master' 2019-08-20 15:38:20 +08:00
or 9f48d2384f Transform the schema dataType 2019-08-20 15:36:34 +08:00
judy0131 b4d790ce83 modify debug run mode api 2019-08-19 18:54:03 +08:00
or 89fb2fb5b0
Update ScopusSearchArticle.scala 2019-08-19 17:14:21 +08:00
judy0131 6873944e02 modify flow debug api 2019-08-15 14:26:41 +08:00
or 2e36dd9565
Update OracleRead.scala
fix a bug  about (ORA-00933: SQL command not properly ended)
2019-08-06 17:18:47 +08:00
or b855031fd8
Update ExecuteSQLStop.scala 2019-08-06 16:54:53 +08:00
or 207396b25a repair a bug where a title request has multiple results 2019-08-05 17:01:12 +08:00
or 8ec4bf848f repair a bug where a title request has multiple results 2019-08-05 16:29:26 +08:00
or f57d03d58a add nsfc scopus stop 2019-08-02 17:47:40 +08:00
judy0131 0ca125bae1 fix bug: piflow-web does not work when there are implemented functions in ConfigurableStop 2019-08-01 15:05:10 +08:00
coco11563 ec1680aadc Done distinct part 2019-07-31 19:45:45 +08:00
coco11563 99bbac29b4 bug fix
method implement
2019-07-31 16:30:57 +08:00
coco11563 409933a43c Merge remote-tracking branch 'origin/master' 2019-07-31 15:44:33 +08:00
coco11563 a701e8ffa4 work on product distinct 2019-07-31 15:44:19 +08:00
judy_0131 50acf9c6fd fix bug: ConfigurableIncrementalStop throw file not found exception 2019-07-31 14:29:14 +08:00
judy0131 cfeca6dbe3 modify pom.xml for spark 2019-07-30 16:01:03 +08:00
judy_0131 1d7e3dc58a fix mysql incremental stop bug 2019-07-30 15:55:01 +08:00
judy0131 58f710867d add status command for piflow 2019-07-29 16:08:15 +08:00
judy_0131 8b88500c1e fix putHiveQL bug 2019-07-29 15:11:25 +08:00
judy_0131 0839e1c1a1 fix putHiveQL bug 2019-07-29 13:52:19 +08:00
coco11563 aab8b7854d add next phase class
`product distinct part`
`foreign key wash`
2019-07-26 16:40:25 +08:00
coco11563 c62215120c done the person distinct 2019-07-26 16:10:35 +08:00
coco11563 a76ad0b868 bug fix 2019-07-26 11:23:43 +08:00
coco11563 e9ddb1d1b0 bug fix 2019-07-26 11:20:45 +08:00
coco11563 7aadd02b0a bug fix 2019-07-26 10:29:56 +08:00
coco11563 126f9f8383 bug fix 2019-07-26 10:27:35 +08:00
Shaow 5467dd9544
Update RedisUtil.scala
forced to update redis utils
2019-07-26 10:24:00 +08:00
judy0131 0c6e0a89c5 modify spark.version to 2.1.0 2019-07-26 10:18:24 +08:00
judy_0131 3c546ed84f modify SelecHiveQl inport 2019-07-26 10:07:43 +08:00
coco11563 f4ccd0afee Merge remote-tracking branch 'origin/master' 2019-07-26 09:58:04 +08:00
coco11563 6576e70280 bug fix 2019-07-26 09:57:44 +08:00
coco11563 01189e97aa file update 2019-07-26 09:56:32 +08:00
judy_0131 57ce7273c9 test 2019-07-26 08:49:39 +08:00
judy0131 01bf0250f2 Merge remote-tracking branch 'origin/master'
# Conflicts:
#	piflow-bundle/piflow-bundle.iml
#	piflow-core/piflow-core.iml
2019-07-26 08:46:40 +08:00
judy0131 10756edc57 test 2019-07-26 08:46:17 +08:00
judy_0131 6053e1fdca Merge remote-tracking branch 'origin/master' 2019-07-25 16:05:55 +08:00
judy_0131 abf19acc0f fix bug: can not connect to hive metastore 2019-07-25 16:04:27 +08:00
coco11563 7c6ce8313f Merge branch 'master' of C:\Users\coco1\IdeaProjects\piflow with conflicts. 2019-07-25 15:41:28 +08:00
coco11563 fa8c203207 adding passwd config in redis 2019-07-25 11:34:59 +08:00
coco11563 bf9f235464 done the redis persist 2019-07-25 11:24:36 +08:00
judy0131 23a65292fa fix bug: show log error 2019-07-24 08:25:12 +08:00