Commit Graph

94 Commits

Author SHA1 Message Date
judy0131 1fd1dae8b1 optimize code 2020-03-23 19:17:12 +08:00
judy0131 b3e1f9b0d1 add getResourceInfo API 2020-03-23 18:51:56 +08:00
judy0131 ab29f7ac06 fix bug: server.ip not found 2020-03-23 15:44:38 +08:00
judy0131 bbd9505801 save schedule info into database, and add getScheduleInfo api 2020-03-16 15:19:20 +08:00
judy0131 1a6529f1c1 Merge remote-tracking branch 'origin/master' 2020-03-13 17:28:33 +08:00
judy0131 5145a111e6 1. remove project
2. schedule group which contains groups and flows
3. start piflow without hive if you do not need hive
2020-03-13 16:50:08 +08:00
yanggang 5d1e2bdd81 add stop 2020-03-10 15:24:15 +08:00
judy0131 c1532573af fix bug 2020-01-19 18:51:54 +08:00
judy0131 714f48ce80 remove server.ip configure item 2020-01-19 18:15:09 +08:00
judy0131 4a36e05c08 remove piflowbundle configure item 2020-01-19 17:12:07 +08:00
judy0131 b245a7f6b4 remove yarn.url configure item 2020-01-19 10:52:05 +08:00
judy0131 c0991b3cda optimize configure file
1.remove yarn related config
2.remove bundle path config
3.remove debug.path, checkpointPath and incrementPath config
2020-01-17 18:03:06 +08:00
judy_0131 4f41ba9378 fix bug for FlowLauncher 2020-01-17 09:49:18 +08:00
judy_0131 2b9ab7ef42 Merge remote-tracking branch 'origin/master' 2020-01-16 17:01:48 +08:00
judy_0131 64382528e0 add other jars for spark application 2020-01-16 16:59:51 +08:00
yanggang 9dd8b9b731 repair a bug ,Parameter contains ‘ } ’ , JSON file auto wrap, unable to parse .
annotating code: // flowJson = flowJson.replaceAll("}","}\n")
2020-01-16 16:35:39 +08:00
judy0131 2a9229103f add h2db version control 2019-12-06 10:56:08 +08:00
judy0131 ac6ff3fd88 fix bug:
1.can not connect hive
2.upgrade h2db schema for v6.0
2019-12-03 18:11:50 +08:00
judy0131 5e124a441e add getFlowGroupProgress API 2019-11-18 15:59:06 +08:00
judy0131 0c7e881640 fix bug: update flowGroup's status where flow is failed. 2019-10-30 16:54:10 +08:00
judy0131 f5b3c3eee2 1.add properties from DataFrame in piflow
2.implement route by customized Properties
2019-09-06 15:15:11 +08:00
judy_0131 f599d6e36d fix bug: sparklauncher launch executor number error 2019-08-27 15:38:03 +08:00
judy0131 b4d790ce83 modify debug run mode api 2019-08-19 18:54:03 +08:00
judy0131 6873944e02 modify flow debug api 2019-08-15 14:26:41 +08:00
judy_0131 50acf9c6fd fix bug: ConfigurableIncrementalStop throw file not found exception 2019-07-31 14:29:14 +08:00
judy_0131 0839e1c1a1 fix putHiveQL bug 2019-07-29 13:52:19 +08:00
coco11563 e9ddb1d1b0 bug fix 2019-07-26 11:20:45 +08:00
judy0131 10756edc57 test 2019-07-26 08:46:17 +08:00
judy0131 b589211c1a fix bug 2019-07-23 18:10:47 +08:00
judy0131 b85fd2cc54 1.optimize code
2.fix bug
2019-07-22 11:14:36 +08:00
judy0131 db63cfa57d Merge remote-tracking branch 'origin/master' 2019-07-19 18:35:17 +08:00
judy0131 acf29d16bd increment for jdbc type 2019-07-19 18:34:59 +08:00
coco11563 02ad523f53 adding nsfc module 2019-07-17 18:01:26 +08:00
judy0131 8eea5e0041 fix bug: start flow slowly 2019-06-21 15:12:32 +08:00
judy0131 a8aab1951d fix bug 2019-05-16 16:29:35 +08:00
judy0131 ac4e3043d6 add getProjectInfo API 2019-05-16 16:06:26 +08:00
judy0131 7ee00efec5 add getFlowGroupInfo API 2019-05-16 15:46:11 +08:00
judy0131 c64f492db6 update state when stop flowGroup or project 2019-05-16 10:03:42 +08:00
judy0131 c8c01811b4 monitor project 2019-05-15 12:27:13 +08:00
judy0131 0fff9ec29b monitor flow group
1.change the schema of table Flow
2.add table flowGroup and project
3.store flow group data into db
2019-05-15 09:28:40 +08:00
judy0131 760a564c19 add terminal project api 2019-05-10 18:03:28 +08:00
judy0131 33e4561072 add terminal flowGroup API 2019-05-09 17:38:19 +08:00
judy0131 f36dd9cf64 optimize code 2019-05-08 11:17:01 +08:00
judy0131 da63af8562 add FlowLauncher 2019-05-08 11:01:49 +08:00
judy0131 7deb8946c7 support run project API 2019-05-05 15:34:35 +08:00
judy0131 1754a233cd 1.add json util
2. fix bug: launch spark application for each flow in FlowGroup
2019-04-30 16:29:22 +08:00
judy0131 76fa9280c2 support run FlowGroup API 2019-04-26 18:02:54 +08:00
judy0131 836e599c7a optimize condition for project and flowgroup 2019-04-25 14:15:52 +08:00
judy0131 c996bc72c0 1.support the execution of project which include FlowGroups and Flows
2.the code need to be optimized!!!
2019-04-19 16:46:46 +08:00
judy0131 a0764ceb68 1. modify show data function
2. fix bug: when more than 5 requests of starting flow are posted, piflow server will get exception:No element passed in the last 1 minute
2019-03-27 15:09:34 +08:00