Commit Graph

79 Commits

Author SHA1 Message Date
bookug 9dc6399ddf fix: bugs in build 2018-09-27 23:52:44 +08:00
bookug 4b4ccc8385 feat: forbidden the openmp sort to speed up;
by zengli
2018-04-24 16:45:35 +08:00
bookug bf22f41bd3 Merge branch 'qinzongyue' into dev
merge qinzongyue's optimizations for key-value indices
2018-04-15 15:15:41 +08:00
bookug 8cfb633bfd docs: int type in Util::spo_cmp remains to be solved 2018-03-28 16:06:15 +08:00
bookug 66dbee493b feat: merge branch of suxunbin;
add support for parallel sort using openmp;

by suxunbin
2018-03-26 19:26:44 +08:00
bookug 1de2fe1b4f feat: add itoa to Util 2018-03-16 15:00:28 +08:00
ZongyueQin a6daca4792 Add: Replace IVTree with IVArray 2018-02-13 11:37:54 +08:00
suxunbin 3fb748104c Add: add parallel sort using openmp 2018-02-02 19:03:05 +08:00
root d9d14f1320 Modify: modify std::sort to parallelsort using openmp 2017-12-24 14:43:25 +08:00
bookug 3719970514 fix: support 12000 query threads now;
merge the modifications of chenjiaqi;
it is the opened socket for each connection that reall matters;

by zengli
2017-10-27 13:58:35 +08:00
bookug e2dd57de76 docs: add some comment 2017-10-27 00:44:05 +08:00
bookug 8bc423fb95 feat: add parallism for ghttp;
use C++11 thread, each for a query;
lock teh whole database when load/build/unload;
lock teh database when running update query;
query cache and the whole KVstore not resolved;
debug_lock should be removed later;
A query thread can open file in Util::memoryLeft once, and may also use Stream which will also open several files, so the limits of system must be increased to support high parallism;

by zengli, bugs to do
2017-10-26 21:24:44 +08:00
bookug 546f56790a Merge branch 'chenjiaqi'
merge chenjia's fixes and optimization to Query:: getFinalResult
2017-10-26 19:33:55 +08:00
bookug a7f98e0baf docs: forbid endpoint mode by default 2017-10-19 20:11:54 +08:00
bookug 438c4c48a5 Merge branch 'bookug' into parallel
get the latest message
2017-10-19 19:41:48 +08:00
lijing a1738defef update monitor 2017-10-19 19:34:52 +08:00
bookug 9629682786 feat: parallism;
use multiple processes for query processing now;

by zengli
2017-10-19 19:28:28 +08:00
magicpanda0618 7f3b89587f perf: work better for a large number of results
by chenjiaqi
2017-10-17 20:49:29 +08:00
ZongyueQin 4b14337f56 <fix> fix the bug that after gsub and gadd first 3000 triples of LUBM500M.nt, result of q15 is wrong 2017-10-09 20:06:57 +08:00
ZongyueQin 05d9d0dc35 Merge branch 'master' into qinzongyue
Conflicts:
	KVstore/ISTree/ISTree.cpp
	KVstore/IVTree/IVTree.cpp
	KVstore/KVstore.cpp
	KVstore/SITree/SITree.cpp

merge master into the branch
2017-08-08 15:15:44 +08:00
bookug 1f3fcc966a perf: no backup and limit time in Endpoint
no need to use backup function when ghttp used as SPARQL Endpoint;
query time is limited to 1 minute in SPARQL Endpoint by default;

by zengli
2017-08-06 22:15:55 +08:00
ZongyueQin f069bd5bee <fix> <fix a bug in cache of Vlist> 2017-08-02 23:21:36 +08:00
bookug 11edefed54 style: add get_data_time to print query logs 2017-07-31 21:22:45 +08:00
bookug 0ed7148287 fix: bugs in ghttp;
also bugs left for download and delete in firefox, chrome and Edge;

by zengli
2017-07-30 14:17:56 +08:00
bookug 7753459dc2 feat: enhance the HTTP server;
merge lijing's code, support a good sparql endpoint;
bug in download file, and unable to visit by inputing URLs in browser directly;

by lijing and zengli
2017-07-25 23:19:05 +08:00
bookug 8d1699a16d Merge branch 'qinzongyue' into bookug
merge qinzongyue's code to deal with double-free error when unloading
database
2017-07-17 21:07:03 +08:00
bookug 40339f5db6 docs: add notes 2017-07-17 21:04:45 +08:00
ZongyueQin cc0ea8a803 <fix> <add "pointer = NULL" after delete a pointer>
The files modified include Database.cpp ISTree.cpp ISStorage.cpp IVTree.cpp IVTree.h IVStorage.cpp KVstore.cppSITree.cpp SIStorage.cpp ClassForVlistCache.h Vlist.cpp
2017-07-17 14:04:35 +08:00
ZongyueQin 74471b9476 refactor in Vlist.cpp 2017-07-16 13:49:17 +08:00
qinzongyue 25bd51ec88 fix a bug in ~Vlist() 2017-07-16 13:36:52 +08:00
qinzongyue 3a06709ed2 <fix> <fix a bug in construcion of vlist> 2017-07-15 17:19:14 +08:00
ZongyueQin e588f147e9 fix a bug
fix a bug
2017-07-15 11:30:18 +08:00
ZongyueQin dd43c95d12 fix bug
fix a bug
2017-07-15 11:29:19 +08:00
ZongyueQin 47c41670a7 add cache for vlist
add cache for vlist
2017-07-15 10:19:29 +08:00
ZongyueQin e8f3eb8243 Add cache for vlist
Add membets and funcions used for cache of vlist
2017-07-15 10:12:12 +08:00
ZongyueQin 0cd6b75026 Create ClassForVlistCache.h
Add class KEY_SIZE_VALUE, used in database.cpp to find important subIDs and objIDs.
Add class Longlist_inMem, used in Vlist as cache
2017-07-15 10:08:43 +08:00
bookug ae5e610acc fix: bug in KVstore and Join;
mess code in KVstore due to read after request() release the pointer;
lack of empty judgement in Join::pre_handler;

by zengli
2017-07-12 20:33:44 +08:00
bookug 17e0ff2b46 fix: set READ_WRITE as default database mode
choose to set or not: ONLY_READ in Util.h
if used as sparql endpoint, set it to save memory;
otherwise, not set it to support insert/delete;

by zengli
2017-06-26 21:47:32 +08:00
bookug 670093e42a feat: add monitor for Http server
not finished, just a start

by zengli, no changes to others
2017-06-15 21:22:03 +08:00
bookug 38575b16e6 fix: forbid vlist cache 2017-06-13 15:24:00 +08:00
bookug fa147526f1 feat: use multithreading to load;
fix type bugs in string index;

by zengli
2017-06-06 18:56:46 +08:00
bookug 9903c3d5cb refactor: adjust vlist and merge signature;
add cache for VList;
use binding in Signature;

by zengli and qinzongyue
2017-05-19 23:05:38 +08:00
bookug c11088ee3e feat: merge wlb branch;
support backup in gserver but not in HttpConnector;

by zengli
2017-05-18 23:27:58 +08:00
bookug 77499f990e feat: merge http branch 2017-05-18 22:56:41 +08:00
bookug 25e1c3ed10 feat: merge type branch;
value branch has already been merged into type;

by zengli
2017-05-18 22:35:22 +08:00
bookug 3f2375dd85 refactor: add comments 2017-05-18 22:08:06 +08:00
bookug 405bb21a9a fix: bugs with ISTree and KVstore;
virtual functions not matched in ISTree;
unsigned type matching error in KVstore;

both fixed, by zengli
2017-05-18 14:42:48 +08:00
bookug f3202ada40 refactor: merge type and value branch;
TODO: bug exists with ISTree;

by zengli
2017-05-17 20:46:02 +08:00
bookug a0e470727c refactor: to use hash instead of sort for candidates in Join
by zengli
2017-04-13 20:01:17 +08:00
bookug 2da666757d feat: add recovery function
if load a db and quit on accidents, you can start the gconsole in native mode on the db server,
and use restore command to recover to teh latest db (backup function will be auto started when you connect to gserver and load
a db)
in addition, gserver stablity is improved to deal with query fails

by wanglibo, no modifications to others
2017-04-11 15:26:35 +08:00