Commit Graph

109 Commits

Author SHA1 Message Date
bookug 4b4ccc8385 feat: forbidden the openmp sort to speed up;
by zengli
2018-04-24 16:45:35 +08:00
bookug bf22f41bd3 Merge branch 'qinzongyue' into dev
merge qinzongyue's optimizations for key-value indices
2018-04-15 15:15:41 +08:00
bookug 66dbee493b feat: merge branch of suxunbin;
add support for parallel sort using openmp;

by suxunbin
2018-03-26 19:26:44 +08:00
ZongyueQin 416385c6af Fix: Fix a bug in Strategy.cpp and optimize for gbuild 2018-03-25 15:14:03 +08:00
bookug aa586d5273 fix: bug in Strategy;
by hulin
2018-03-22 14:46:58 +08:00
ZongyueQin 98e1d88b08 Add: Replace ISTree with ISArray, and fix some bugs in IVArray 2018-02-24 09:33:21 +08:00
ZongyueQin a6daca4792 Add: Replace IVTree with IVArray 2018-02-13 11:37:54 +08:00
suxunbin 3fb748104c Add: add parallel sort using openmp 2018-02-02 19:03:05 +08:00
ZongyueQin 5698851e43 Merge branch 'hulin' into qinzongyue 2018-01-30 15:57:34 +08:00
hulin12138 2048d38588 Merge branch 'bookug' into hulin 2018-01-30 15:24:44 +08:00
hulin12138 e79cd86e11 modify to pre_handler 2018-01-30 14:59:14 +08:00
bookug 6b9532c815 fix: error with sizeof(int**) in Database.cpp 2018-01-27 22:17:47 +08:00
ZongyueQin 315cf44d23 Add: an update of String Compressing part 2018-01-27 12:49:00 +08:00
ZongyueQin 60e36878e0 Fix: optimize calling of string compressing 2018-01-24 23:31:59 +08:00
ZongyueQin cd42d10888 Add: Compress strings when building database 2018-01-22 21:27:46 +08:00
root d9d14f1320 Modify: modify std::sort to parallelsort using openmp 2017-12-24 14:43:25 +08:00
bookug 75a662e521 docs: add/sub some notations 2017-12-21 16:17:34 +08:00
bookug 45b4a9e660 docs: add test for dbpedia 2017-12-21 13:50:56 +08:00
bookug e5fba910aa fix: bug in IVTree::preLoad insertion/deletion 2017-11-10 18:43:27 +08:00
bookug 3719970514 fix: support 12000 query threads now;
merge the modifications of chenjiaqi;
it is the opened socket for each connection that reall matters;

by zengli
2017-10-27 13:58:35 +08:00
bookug 8bc423fb95 feat: add parallism for ghttp;
use C++11 thread, each for a query;
lock teh whole database when load/build/unload;
lock teh database when running update query;
query cache and the whole KVstore not resolved;
debug_lock should be removed later;
A query thread can open file in Util::memoryLeft once, and may also use Stream which will also open several files, so the limits of system must be increased to support high parallism;

by zengli, bugs to do
2017-10-26 21:24:44 +08:00
bookug 438c4c48a5 Merge branch 'bookug' into parallel
get the latest message
2017-10-19 19:41:48 +08:00
bookug 9629682786 feat: parallism;
use multiple processes for query processing now;

by zengli
2017-10-19 19:28:28 +08:00
bookug 160e6b3123 Merge branch 'qinzongyue'
fix bug in vlist cache with insertions or deletions
2017-10-09 20:45:49 +08:00
ZongyueQin 4b14337f56 <fix> fix the bug that after gsub and gadd first 3000 triples of LUBM500M.nt, result of q15 is wrong 2017-10-09 20:06:57 +08:00
bookug b45934d073 Merge branch 'chenjiaqi'
update Query Cache if there are insertions or deletions in the database
2017-09-24 18:07:03 +08:00
magicpanda0618 2c64f1f954 fix: a bug when use QueryCache
clear QueryCache after any UPDATE query
by chenjiaqi
2017-09-24 18:01:46 +08:00
bookug b8d7cd2158 Merge branch 'hulin'
fix bugs in make
2017-09-19 13:52:04 +08:00
hulin12138 6e6216d0aa move pre_handler to stragety && optimize pre_handler 2017-09-19 13:43:08 +08:00
bookug de58b9b389 Merge branch 'hulin'
adjust the structure of filter and optimize the prehandler
2017-09-19 13:19:10 +08:00
hulin12138 31bcc83fa8 put pre_handler in stragety && optimize the pre_handler 2017-09-19 12:42:15 +08:00
magicpanda0618 1caf4be04b perf: add QueryCache
determine whether new query and cached query are isomorphism

by cuihao and chenjiaqi
2017-09-06 14:17:20 +08:00
hulin12138 5116653533 optimize the prehandler 2017-09-06 10:06:57 +08:00
ZongyueQin 05d9d0dc35 Merge branch 'master' into qinzongyue
Conflicts:
	KVstore/ISTree/ISTree.cpp
	KVstore/IVTree/IVTree.cpp
	KVstore/KVstore.cpp
	KVstore/SITree/SITree.cpp

merge master into the branch
2017-08-08 15:15:44 +08:00
bookug 1f3fcc966a perf: no backup and limit time in Endpoint
no need to use backup function when ghttp used as SPARQL Endpoint;
query time is limited to 1 minute in SPARQL Endpoint by default;

by zengli
2017-08-06 22:15:55 +08:00
ZongyueQin f069bd5bee <fix> <fix a bug in cache of Vlist> 2017-08-02 23:21:36 +08:00
bookug 11edefed54 style: add get_data_time to print query logs 2017-07-31 21:22:45 +08:00
bookug c0119300df Merge branch 'chenjiaqi' into bookug
merge chenjiaqi's code
2017-07-29 12:08:19 +08:00
bookug af093913c9 refactor: fix ghttp and add function 2017-07-29 12:00:51 +08:00
bookug e94eafc613 docs: modify the java api for new REST interface;
bug exists in the HTTP transformation;

by zengli
2017-07-27 17:54:45 +08:00
magicpanda0618 aac9638541 fix a bug when occuring OPTIONAL_GROUP_PATTERN; optimize the performance of StringIndex; 2017-07-27 15:58:51 +08:00
bookug 7753459dc2 feat: enhance the HTTP server;
merge lijing's code, support a good sparql endpoint;
bug in download file, and unable to visit by inputing URLs in browser directly;

by lijing and zengli
2017-07-25 23:19:05 +08:00
bookug 7b2792bbd4 style: remove bug info 2017-07-17 22:58:13 +08:00
bookug 72526284fd Merge branch 'hulin' into bookug
merge hulin's code to deal with special pre vars structure in Join
2017-07-17 21:07:47 +08:00
hulin12138 029f8cfdf7 add handler for pre vars 2017-07-17 16:27:41 +08:00
ZongyueQin cc0ea8a803 <fix> <add "pointer = NULL" after delete a pointer>
The files modified include Database.cpp ISTree.cpp ISStorage.cpp IVTree.cpp IVTree.h IVStorage.cpp KVstore.cppSITree.cpp SIStorage.cpp ClassForVlistCache.h Vlist.cpp
2017-07-17 14:04:35 +08:00
qinzongyue aa9569a643 <fix> <fix bugs in get_candiate_preID, get_important_subID, get_important_objID> 2017-07-16 15:47:21 +08:00
bookug d0bf0ac6a0 fix: bugs in update queries;
after abandoning vstree, the calling of vstree in insert/delete must be removed;

by zengli
2017-07-15 20:03:43 +08:00
qinzongyue 45e87ce393 <feat> <add Vlist's cache in preID2values>
I added Vlist's cache in preID2values. Notice the members' name, they mey be confusing.
2017-07-15 15:12:32 +08:00
ZongyueQin b51281dedf Add Vlist's cache to preID2values
Add functions to load Vlist's cache in p2values
2017-07-15 14:08:39 +08:00