Zongyue
0f0eb86ba9
Fix: remove trie, fix bugs in IS(IV)BlockManager, remove curKeyNum
2018-10-19 05:37:22 +08:00
Zongyue
760e9ae9b9
Revert "Fix: remove trie and fix bugs in IS(IV)BlockManager.cpp"
...
This reverts commit 15521f6132
.
2018-10-19 05:26:01 +08:00
Zongyue
15521f6132
Fix: remove trie and fix bugs in IS(IV)BlockManager.cpp
2018-10-19 04:57:06 +08:00
bookug
c03aaf00b1
fix: the repeating insert/delete bug
2018-10-18 22:19:11 +08:00
bookug
773d85af9a
docs: add extra comments and found bugs in ISArray::remove()
2018-10-18 19:35:41 +08:00
bookug
fb485d5725
fix: library dependency in makefile;
...
add make -j4 function to documents
2018-10-18 01:19:25 +08:00
ywang1111
3fd931d970
sub useless cerr
2018-10-06 22:32:26 +08:00
ywang1111
cd8a107990
output log (temporary)
2018-10-05 00:42:50 +08:00
bookug
9dc6399ddf
fix: bugs in build
2018-09-27 23:52:44 +08:00
bookug
d191432c34
Merge branch 'suxunbin' into dev
...
merge branch of suxunbin, adding thread pool to ghttp server
2018-09-19 01:20:58 +08:00
bookug
68ba02cd37
feat: lock query cache;
...
add files to record unsolved bugs;
getFinalResult is locked in Database::query();
2018-09-19 01:10:10 +08:00
bookug
5572c3233f
feat: clear query cache only when updates really happen
2018-09-17 21:04:19 +08:00
suxunbin
0d7df1b687
Add ThreadPool to ghttp
2018-09-17 16:13:15 +08:00
bookug
3bdc0d4d92
feat: add boost installation to setup for CentOS
2018-09-14 16:44:57 +08:00
bookug
b77511cd7e
feat: forbid trie
2018-09-13 21:02:43 +08:00
bookug
da87ec06e5
docs: remove string buffer from system;
...
the reason is that several levels of indices have similar functions;
this buffer is costly and limited when new IDs are inserted;
there exists bugs when queries containing updates are handled;
by zengli
2018-09-11 20:53:39 +08:00
bookug
45cd499110
fix: forbid string buffer from string index
2018-09-07 13:40:22 +08:00
bookug
355b8b0d8c
feat: merge qinzongyue branch and forbid trie;
...
trie does not bring profits but causes several problems;
2018-09-06 14:43:02 +08:00
ZongyueQin
05fab97456
Fix&Add: Fix a bug caused by trie, change the way of parallize,
...
add test_parallel to test parallize performance
2018-08-09 14:14:33 +08:00
Zongyue
7a3b8ce783
Add: improve parallel performance
2018-07-30 22:23:19 +08:00
Zongyue
36945894c5
Fix: a bug caused by preloading a value bigger than 2G
2018-07-21 12:42:49 +08:00
Zongyue
6dc71da836
Add: Preload in cache 6G important long key-value pairs that would not be swaped out
2018-07-18 20:28:10 +08:00
bookug
4b4ccc8385
feat: forbidden the openmp sort to speed up;
...
by zengli
2018-04-24 16:45:35 +08:00
bookug
bf22f41bd3
Merge branch 'qinzongyue' into dev
...
merge qinzongyue's optimizations for key-value indices
2018-04-15 15:15:41 +08:00
bookug
66dbee493b
feat: merge branch of suxunbin;
...
add support for parallel sort using openmp;
by suxunbin
2018-03-26 19:26:44 +08:00
ZongyueQin
98e1d88b08
Add: Replace ISTree with ISArray, and fix some bugs in IVArray
2018-02-24 09:33:21 +08:00
ZongyueQin
a6daca4792
Add: Replace IVTree with IVArray
2018-02-13 11:37:54 +08:00
suxunbin
3fb748104c
Add: add parallel sort using openmp
2018-02-02 19:03:05 +08:00
ZongyueQin
5698851e43
Merge branch 'hulin' into qinzongyue
2018-01-30 15:57:34 +08:00
bookug
6b9532c815
fix: error with sizeof(int**) in Database.cpp
2018-01-27 22:17:47 +08:00
ZongyueQin
315cf44d23
Add: an update of String Compressing part
2018-01-27 12:49:00 +08:00
ZongyueQin
60e36878e0
Fix: optimize calling of string compressing
2018-01-24 23:31:59 +08:00
ZongyueQin
cd42d10888
Add: Compress strings when building database
2018-01-22 21:27:46 +08:00
root
d9d14f1320
Modify: modify std::sort to parallelsort using openmp
2017-12-24 14:43:25 +08:00
bookug
75a662e521
docs: add/sub some notations
2017-12-21 16:17:34 +08:00
bookug
45b4a9e660
docs: add test for dbpedia
2017-12-21 13:50:56 +08:00
bookug
e5fba910aa
fix: bug in IVTree::preLoad insertion/deletion
2017-11-10 18:43:27 +08:00
bookug
3719970514
fix: support 12000 query threads now;
...
merge the modifications of chenjiaqi;
it is the opened socket for each connection that reall matters;
by zengli
2017-10-27 13:58:35 +08:00
bookug
8bc423fb95
feat: add parallism for ghttp;
...
use C++11 thread, each for a query;
lock teh whole database when load/build/unload;
lock teh database when running update query;
query cache and the whole KVstore not resolved;
debug_lock should be removed later;
A query thread can open file in Util::memoryLeft once, and may also use Stream which will also open several files, so the limits of system must be increased to support high parallism;
by zengli, bugs to do
2017-10-26 21:24:44 +08:00
bookug
438c4c48a5
Merge branch 'bookug' into parallel
...
get the latest message
2017-10-19 19:41:48 +08:00
bookug
9629682786
feat: parallism;
...
use multiple processes for query processing now;
by zengli
2017-10-19 19:28:28 +08:00
bookug
160e6b3123
Merge branch 'qinzongyue'
...
fix bug in vlist cache with insertions or deletions
2017-10-09 20:45:49 +08:00
ZongyueQin
4b14337f56
<fix> fix the bug that after gsub and gadd first 3000 triples of LUBM500M.nt, result of q15 is wrong
2017-10-09 20:06:57 +08:00
magicpanda0618
2c64f1f954
fix: a bug when use QueryCache
...
clear QueryCache after any UPDATE query
by chenjiaqi
2017-09-24 18:01:46 +08:00
magicpanda0618
1caf4be04b
perf: add QueryCache
...
determine whether new query and cached query are isomorphism
by cuihao and chenjiaqi
2017-09-06 14:17:20 +08:00
ZongyueQin
05d9d0dc35
Merge branch 'master' into qinzongyue
...
Conflicts:
KVstore/ISTree/ISTree.cpp
KVstore/IVTree/IVTree.cpp
KVstore/KVstore.cpp
KVstore/SITree/SITree.cpp
merge master into the branch
2017-08-08 15:15:44 +08:00
bookug
1f3fcc966a
perf: no backup and limit time in Endpoint
...
no need to use backup function when ghttp used as SPARQL Endpoint;
query time is limited to 1 minute in SPARQL Endpoint by default;
by zengli
2017-08-06 22:15:55 +08:00
ZongyueQin
f069bd5bee
<fix> <fix a bug in cache of Vlist>
2017-08-02 23:21:36 +08:00
bookug
11edefed54
style: add get_data_time to print query logs
2017-07-31 21:22:45 +08:00
bookug
af093913c9
refactor: fix ghttp and add function
2017-07-29 12:00:51 +08:00