Commit Graph

131 Commits

Author SHA1 Message Date
Zongyue 0f0eb86ba9 Fix: remove trie, fix bugs in IS(IV)BlockManager, remove curKeyNum 2018-10-19 05:37:22 +08:00
Zongyue 760e9ae9b9 Revert "Fix: remove trie and fix bugs in IS(IV)BlockManager.cpp"
This reverts commit 15521f6132.
2018-10-19 05:26:01 +08:00
Zongyue 15521f6132 Fix: remove trie and fix bugs in IS(IV)BlockManager.cpp 2018-10-19 04:57:06 +08:00
bookug c03aaf00b1 fix: the repeating insert/delete bug 2018-10-18 22:19:11 +08:00
bookug 773d85af9a docs: add extra comments and found bugs in ISArray::remove() 2018-10-18 19:35:41 +08:00
bookug fb485d5725 fix: library dependency in makefile;
add make -j4 function to documents
2018-10-18 01:19:25 +08:00
ywang1111 3fd931d970 sub useless cerr 2018-10-06 22:32:26 +08:00
ywang1111 cd8a107990 output log (temporary) 2018-10-05 00:42:50 +08:00
bookug 9dc6399ddf fix: bugs in build 2018-09-27 23:52:44 +08:00
bookug d191432c34 Merge branch 'suxunbin' into dev
merge branch of suxunbin, adding thread pool to ghttp server
2018-09-19 01:20:58 +08:00
bookug 68ba02cd37 feat: lock query cache;
add files to record unsolved bugs;
getFinalResult is locked in Database::query();
2018-09-19 01:10:10 +08:00
bookug 5572c3233f feat: clear query cache only when updates really happen 2018-09-17 21:04:19 +08:00
suxunbin 0d7df1b687 Add ThreadPool to ghttp 2018-09-17 16:13:15 +08:00
bookug 3bdc0d4d92 feat: add boost installation to setup for CentOS 2018-09-14 16:44:57 +08:00
bookug b77511cd7e feat: forbid trie 2018-09-13 21:02:43 +08:00
bookug da87ec06e5 docs: remove string buffer from system;
the reason is that several levels of indices have similar functions;
this buffer is costly and limited when new IDs are inserted;
there exists bugs when queries containing updates are handled;

by zengli
2018-09-11 20:53:39 +08:00
bookug 45cd499110 fix: forbid string buffer from string index 2018-09-07 13:40:22 +08:00
bookug 355b8b0d8c feat: merge qinzongyue branch and forbid trie;
trie does not bring profits but causes several problems;
2018-09-06 14:43:02 +08:00
ZongyueQin 05fab97456 Fix&Add: Fix a bug caused by trie, change the way of parallize,
add test_parallel to test parallize performance
2018-08-09 14:14:33 +08:00
Zongyue 7a3b8ce783 Add: improve parallel performance 2018-07-30 22:23:19 +08:00
Zongyue 36945894c5 Fix: a bug caused by preloading a value bigger than 2G 2018-07-21 12:42:49 +08:00
Zongyue 6dc71da836 Add: Preload in cache 6G important long key-value pairs that would not be swaped out 2018-07-18 20:28:10 +08:00
bookug 4b4ccc8385 feat: forbidden the openmp sort to speed up;
by zengli
2018-04-24 16:45:35 +08:00
bookug bf22f41bd3 Merge branch 'qinzongyue' into dev
merge qinzongyue's optimizations for key-value indices
2018-04-15 15:15:41 +08:00
bookug 66dbee493b feat: merge branch of suxunbin;
add support for parallel sort using openmp;

by suxunbin
2018-03-26 19:26:44 +08:00
ZongyueQin 416385c6af Fix: Fix a bug in Strategy.cpp and optimize for gbuild 2018-03-25 15:14:03 +08:00
bookug aa586d5273 fix: bug in Strategy;
by hulin
2018-03-22 14:46:58 +08:00
ZongyueQin 98e1d88b08 Add: Replace ISTree with ISArray, and fix some bugs in IVArray 2018-02-24 09:33:21 +08:00
ZongyueQin a6daca4792 Add: Replace IVTree with IVArray 2018-02-13 11:37:54 +08:00
suxunbin 3fb748104c Add: add parallel sort using openmp 2018-02-02 19:03:05 +08:00
ZongyueQin 5698851e43 Merge branch 'hulin' into qinzongyue 2018-01-30 15:57:34 +08:00
hulin12138 2048d38588 Merge branch 'bookug' into hulin 2018-01-30 15:24:44 +08:00
hulin12138 e79cd86e11 modify to pre_handler 2018-01-30 14:59:14 +08:00
bookug 6b9532c815 fix: error with sizeof(int**) in Database.cpp 2018-01-27 22:17:47 +08:00
ZongyueQin 315cf44d23 Add: an update of String Compressing part 2018-01-27 12:49:00 +08:00
ZongyueQin 60e36878e0 Fix: optimize calling of string compressing 2018-01-24 23:31:59 +08:00
ZongyueQin cd42d10888 Add: Compress strings when building database 2018-01-22 21:27:46 +08:00
root d9d14f1320 Modify: modify std::sort to parallelsort using openmp 2017-12-24 14:43:25 +08:00
bookug 75a662e521 docs: add/sub some notations 2017-12-21 16:17:34 +08:00
bookug 45b4a9e660 docs: add test for dbpedia 2017-12-21 13:50:56 +08:00
bookug e5fba910aa fix: bug in IVTree::preLoad insertion/deletion 2017-11-10 18:43:27 +08:00
bookug 3719970514 fix: support 12000 query threads now;
merge the modifications of chenjiaqi;
it is the opened socket for each connection that reall matters;

by zengli
2017-10-27 13:58:35 +08:00
bookug 8bc423fb95 feat: add parallism for ghttp;
use C++11 thread, each for a query;
lock teh whole database when load/build/unload;
lock teh database when running update query;
query cache and the whole KVstore not resolved;
debug_lock should be removed later;
A query thread can open file in Util::memoryLeft once, and may also use Stream which will also open several files, so the limits of system must be increased to support high parallism;

by zengli, bugs to do
2017-10-26 21:24:44 +08:00
bookug 438c4c48a5 Merge branch 'bookug' into parallel
get the latest message
2017-10-19 19:41:48 +08:00
bookug 9629682786 feat: parallism;
use multiple processes for query processing now;

by zengli
2017-10-19 19:28:28 +08:00
bookug 160e6b3123 Merge branch 'qinzongyue'
fix bug in vlist cache with insertions or deletions
2017-10-09 20:45:49 +08:00
ZongyueQin 4b14337f56 <fix> fix the bug that after gsub and gadd first 3000 triples of LUBM500M.nt, result of q15 is wrong 2017-10-09 20:06:57 +08:00
bookug b45934d073 Merge branch 'chenjiaqi'
update Query Cache if there are insertions or deletions in the database
2017-09-24 18:07:03 +08:00
magicpanda0618 2c64f1f954 fix: a bug when use QueryCache
clear QueryCache after any UPDATE query
by chenjiaqi
2017-09-24 18:01:46 +08:00
bookug b8d7cd2158 Merge branch 'hulin'
fix bugs in make
2017-09-19 13:52:04 +08:00