Commit Graph

36 Commits

Author SHA1 Message Date
bookug 9dc6399ddf fix: bugs in build 2018-09-27 23:52:44 +08:00
bookug 4b4ccc8385 feat: forbidden the openmp sort to speed up;
by zengli
2018-04-24 16:45:35 +08:00
bookug 8cfb633bfd docs: int type in Util::spo_cmp remains to be solved 2018-03-28 16:06:15 +08:00
bookug 66dbee493b feat: merge branch of suxunbin;
add support for parallel sort using openmp;

by suxunbin
2018-03-26 19:26:44 +08:00
bookug 1de2fe1b4f feat: add itoa to Util 2018-03-16 15:00:28 +08:00
suxunbin 3fb748104c Add: add parallel sort using openmp 2018-02-02 19:03:05 +08:00
bookug 3719970514 fix: support 12000 query threads now;
merge the modifications of chenjiaqi;
it is the opened socket for each connection that reall matters;

by zengli
2017-10-27 13:58:35 +08:00
bookug 8bc423fb95 feat: add parallism for ghttp;
use C++11 thread, each for a query;
lock teh whole database when load/build/unload;
lock teh database when running update query;
query cache and the whole KVstore not resolved;
debug_lock should be removed later;
A query thread can open file in Util::memoryLeft once, and may also use Stream which will also open several files, so the limits of system must be increased to support high parallism;

by zengli, bugs to do
2017-10-26 21:24:44 +08:00
bookug 9629682786 feat: parallism;
use multiple processes for query processing now;

by zengli
2017-10-19 19:28:28 +08:00
magicpanda0618 7f3b89587f perf: work better for a large number of results
by chenjiaqi
2017-10-17 20:49:29 +08:00
bookug 11edefed54 style: add get_data_time to print query logs 2017-07-31 21:22:45 +08:00
bookug 9903c3d5cb refactor: adjust vlist and merge signature;
add cache for VList;
use binding in Signature;

by zengli and qinzongyue
2017-05-19 23:05:38 +08:00
bookug c11088ee3e feat: merge wlb branch;
support backup in gserver but not in HttpConnector;

by zengli
2017-05-18 23:27:58 +08:00
bookug 77499f990e feat: merge http branch 2017-05-18 22:56:41 +08:00
bookug 25e1c3ed10 feat: merge type branch;
value branch has already been merged into type;

by zengli
2017-05-18 22:35:22 +08:00
bookug f3202ada40 refactor: merge type and value branch;
TODO: bug exists with ISTree;

by zengli
2017-05-17 20:46:02 +08:00
bookug a0e470727c refactor: to use hash instead of sort for candidates in Join
by zengli
2017-04-13 20:01:17 +08:00
bookug 2da666757d feat: add recovery function
if load a db and quit on accidents, you can start the gconsole in native mode on the db server,
and use restore command to recover to teh latest db (backup function will be auto started when you connect to gserver and load
a db)
in addition, gserver stablity is improved to deal with query fails

by wanglibo, no modifications to others
2017-04-11 15:26:35 +08:00
bookug 80080d1bca refactor: add VList for IVTree
also, lower the copy cost in KVstore

by zengli, all changes closed in KVstore, using new/delete for all instead of malloc/free
2017-04-01 16:03:05 +08:00
bookug 2f7a7a8b69 refactor: move id_tuples to disk in build
to run large datasets like freebase

by zengli, no changes to others
2017-03-29 13:48:39 +08:00
bookug d64358b606 perf: add VList for IVTree; lower the copy cost in KVstore
this work doe not ends

by zengli, maybe conflicates with type branch
2017-03-28 16:56:16 +08:00
bookug 84dbb166c3 update the docs; fix bugs in gconsole and api 2017-03-26 23:21:56 +08:00
bookug 1b939b3a51 change to github to develop 2017-03-24 20:10:43 +08:00
bookug deabdf293f move devGstore to gStore and go on working on github instead of git osc;
improve the init configure file;
 support empty database and indices:you can remove all triples from a db and insert/query;
 change signature struct and generating method in build;
change FIFO to LRU; fix bug in Signature, the int maybe overflow;
test on shape.db, 0.7B triples with 0.42B entities
2017-03-23 21:32:41 +08:00
bookug 74598bf66e fix bugs in api and gclient;
fix bugs in gconsole, pre_var and vstree;
support selected pre vars and parallel edges;
update both en and ch docs
2017-02-17 17:09:47 +08:00
bookug 5e1f5e7a17 version 0.4.0 2017-01-16 14:12:57 +08:00
bookug 7303e40611 add postProcessing and stringIndex for getFinalResult;add insertion/deletion;fix bugs 2016-09-25 22:14:36 +08:00
bookug 52b600d44c add distributed gstore by pengpeng 2016-09-18 20:01:57 +08:00
bookug ab233a19e2 fix bugs in Database::s2po... 2016-06-09 01:26:36 +08:00
bookug 5aedbcd3aa remove wasteful so2p;use p2s or p2o instead of s2p s2o sometimes 2016-05-20 21:57:15 +08:00
bookug 02e54e2c17 merge newest devGstore 2016-05-16 03:16:22 +08:00
bookug 8f4fe83b18 improve join; add not-bgp;fix and better stream;add gconsole;use -O3 2016-04-01 20:58:15 +08:00
bookug 78ad6760d5 not using lfs now 2016-03-12 01:52:18 +08:00
bookug ae9f604a11 remove docs and test 2016-03-12 01:50:36 +08:00
bookug 56ec81216a reinit and adjust 2016-03-04 16:49:06 +08:00
bookug 59d98adaaa merge several classes;
remove most warnnings;
adjust debug system;
add Stream for ResultSet;
cant add Stream for IDlist and maybe not need;
add redirection for gquery console;
add realpath for soft links but not enable;

author: zengli
2015-11-06 19:13:39 +08:00