opensci
/
gStore
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity

help document

This commit is contained in:
summercyy 2018-09-27 18:51:47 +08:00
parent 5bfaf17a7c
commit 388c2d6f50
7 changed files with 142 additions and 5315 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
docs/DEMAND.md
View File

@ -62,7 +62,7 @@ NOTICE:
# ./buildconf --force
# ./configure --help | grep pthreads
You have to see --enable-pthreads listed. If do not, clear the buidls with this commands:
You have to see --enable-pthreads listed. If do not, clear the builds with this commands:
# rm -rf aclocal.m4
# rm -rf autom4te.cache/

168
docs/STRUCT.md
View File

@ -10,7 +10,11 @@
- Join.cpp (join the node candidates to get results)
- Join.h (class, members,, and functions definitions)
- Join.h (class, members and functions definitions)
- Strategy.cpp
- Strategy.h
- KVstore/ (a key-value store to swap between memory and disk)
@ -18,39 +22,133 @@
- KVstore.h
- heap/ (a heap of nodes whose content are in memory)
- Heap.cpp
- ISArray/
- Heap.h
- ISArray.cpp
- ISArray.h
- ISBlockManager.cpp
- ISBlockManager.h
- ISEntry.cpp
- ISEntry.h
- ISTree/
- ISTree.cpp
- ISTree.h
- heap/ (a heap of nodes whose content are in memory)
- ISHeap.cpp
- ISHeap.h
- node/ (all kinds of nodes in B+-tree)
- node/ (all kinds of nodes in B+-tree)
- Node.cpp (the base class of IntlNode and LeafNode)
- ISIntlNode.cpp
- Node.h
- ISIntlNode.h
- IntlNode.cpp (internal nodes in B+-tree)
- ISLeafNode.cpp
- IntlNode.h
- ISLeafNode.h
- LeafNode.cpp (leaf nodes in B+-tree)
- ISNode.cpp
- LeafNode.h
- ISNode.h
- storage/ (swap contents between memory and disk)
- storage/
- file.h
- ISStorage.cpp
- ISStorage.h
- IVArray/
- IVArray.cpp
- IVArray.h
- IVBlockManager.cpp
- IVBlockManager.h
- IVCacheManager.cpp
- IVCacheManger.h
- IVEntry.cpp
- IVEntry.h
- IVTree/
- IVTree.cpp
- IVTree.h
- heap/ (a heap of nodes whose content are in memory)
- Storage.cpp
- IVHeap.cpp
- Storage.h
- IVHeap.h
- node/ (all kinds of nodes in B+-tree)
- tree/ (implement all tree operations and interfaces)
- IVIntlNode.cpp
- Tree.cpp
- IVIntlNode.h
- Tree.h
- IVLeafNode.cpp
- IVLeafNode.h
- IVNode.cpp
- IVNode.h
- storage/
- IVStorage.cpp
- IVStorage.h
- SITree/
- SITree.cpp
- SITree.h
- heap/ (a heap of nodes whose content are in memory)
- SIHeap.cpp
- SIHeap.h
- node/ (all kinds of nodes in B+-tree)
- SIIntlNode.cpp
- SIIntlNode.h
- SILeafNode.cpp
- SILeafNode.h
- SINode.cpp
- SINode.h
- storage/
- SIStorage.cpp
- SIStorage.h
- Query/ (needed to answer SPARQL query)
@ -62,6 +160,10 @@
- IDList.h
- ResultFilter.cpp
- ResultFilter.h
- ResultSet.cpp (keep the result set corresponding to a query)
- ResultSet.h
@ -74,6 +176,10 @@
- Varset.h
- QueryCache.cpp
- QueryCache.h
- QueryTree.cpp
- QueryTree.h
@ -82,6 +188,10 @@
- GeneralEvaluation.h
- TempResult.cpp
- TempResult.h
- RegexExpression.h
- Signature/ (assign signatures for nodes and edges, but not for literals)
@ -170,6 +280,12 @@
- BloomFilter.h
- ClassForVlistCache.h
- VList.cpp
- VList.h
- - -
#### The interface part is listed below:
@ -192,21 +308,19 @@
- Socket.h
- Main/ (a series of applications/main-program to operate on gStore)
- client_http.hpp
- gload.cpp (import a RDF dataset)
- server_http.hpp
- gquery.cpp (query a database)
- gserver.cpp (start up the gStore server)
- gclient.cpp (connect to a gStore server and interact)
- web/
-
- - -
#### More details
To acquire a deep understanding of gStore codes, please go to [Code Detail](pdf/代码目录及概览.pdf). See [use case](pdf/Gstore2.0_useCaseDoc.pdf) to understand the design of use cases, and see [OOA](pdf/OOA_class.pdf) and [OOD](pdf/OOD_class.pdf) for OOA design and OOD design, respectively.
To acquire a deep understanding of gStore codes, please go to [Code Detail](pdf/code_overview.pdf). See [use case](pdf/Gstore2.0_useCaseDoc.pdf) to understand the design of use cases, and see [OOA](pdf/OOA_class.pdf) and [OOD](pdf/OOD_class.pdf) for OOA design and OOD design, respectively.
If you want to know the sequence of a running gStore, please view the list below:

BIN
docs/help/gStore_help.pdf
View File

Binary file not shown.

2600
docs/help/gStore_help.tex
View File

File diff suppressed because it is too large Load Diff

BIN
docs/help/gStore_help_CN.pdf
View File

Binary file not shown.

2323
docs/help/gStore_help_CN.tex
View File

File diff suppressed because it is too large Load Diff

364
docs/help/help.bib
View File

@ -1,364 +0,0 @@
% This file was created with JabRef 2.10.
% Encoding: UTF8
@String { cacm = {Commun. ACM} }
@String { cloud13 = {Proc. IEEE 6th Int. Conf. on Cloud Computing} }
@String { compsur = {ACM Comput. Surv.} }
@String { EDBT12 = {Proc. 15th Int. Conf. on Extending Database Technology} }
@String { ESWC08 = {Proc. 5th European Semantic Web Conf.} }
@String { ESWC14 = {Proc. 11th Extended Semantic Web Conf.} }
@String { ICDE11 = {Proc. 27th Int. Conf. on Data Engineering} }
@String { icde13 = {Proc. 29th Int. Conf. on Data Engineering} }
@String { icde14 = {Proc. 30th Int. Conf. on Data Engineering} }
@String { icdew13 = {Proc. Workshops of 29th Int. Conf. on Data Engineering} }
@String { ieeetkde = {IEEE Trans. Knowl. and Data Eng.} }
@String { iswc11 = {Proc. 10th Int. Semantic Web Conf.} }
@String { iswc14 = {Proc. 13th Int. Semantic Web Conf.} }
@String { jwebs = {J. Web Semantics} }
@String { pvldb = {Proc. VLDB Endowment} }
@String { sc95 = {Proc. ACM/IEEE Conf. on Supercomputing} }
@String { siamjc = {SIAM J. on Comput.} }
@String { sigmod = {Proc. ACM SIGMOD Int. Conf. on Management of Data} }
@String { ssdbm12 = {Proc. 24th Int. Conf. on Scientific and Statistical Database Management} }
@String { tods = {ACM Trans. Database Syst.} }
@String { vldb06 = {Proc. 32nd Int. Conf. on Very Large Data Bases} }
@String { vldbj = {VLDB J.} }
@String { www10 = {Proc. 19th Int. World Wide Web Conf.} }
@String { WWW10 = {Proc. 19th Int. World Wide Web Conf.} }
@String { www12 = {Proc. 21st Int. World Wide Web Conf.} }
@String { www12cv = {Proc. 21st Int. World Wide Web Conf. (Companion Volume)} }
@String { www14cv = {Proc. 23rd Int. World Wide Web Conf. (Companion Volume)} }
@InProceedings{DBLP:conf/semweb/BroekstraKH02,
Title = {Sesame: {A} Generic Architecture for Storing and Querying {RDF} and
{RDF} Schema},
Author = {Jeen Broekstra and
Arjohn Kampman and
Frank van Harmelen},
Booktitle = {The Semantic Web - {ISWC} 2002, First International Semantic Web Conference},
Year = {2002},
Bibsource = {dblp computer science bibliography, http://dblp.org},
Biburl = {http://dblp.uni-trier.de/rec/bib/conf/semweb/BroekstraKH02},
Crossref = {DBLP:conf/semweb/2002},
Doi = {10.1007/3-540-48005-6_7},
Timestamp = {Thu, 30 Jun 2011 15:59:43 +0200},
Url = {http://dx.doi.org/10.1007/3-540-48005-6_7}
}
@InProceedings{DBLP:conf/sigir/Deppisch86,
Title = {S-Tree: {A} Dynamic Balanced Signature Index for Office Retrieval},
Author = {Uwe Deppisch},
Booktitle = {SIGIR'86, Proceedings of the 9th Annual International {ACM} {SIGIR}
Conference on Research and Development in Information Retrieval},
Year = {1986},
Bibsource = {dblp computer science bibliography, http://dblp.org},
Biburl = {http://dblp.uni-trier.de/rec/bib/conf/sigir/Deppisch86},
Crossref = {DBLP:conf/sigir/86},
Doi = {10.1145/253168.253189},
Timestamp = {Thu, 13 Sep 2012 13:14:47 +0200},
Url = {http://doi.acm.org/10.1145/253168.253189}
}
@Article{DBLP:swstore,
Title = {{SW-Store:} a vertically partitioned {DBMS} for Semantic Web data management},
Author = {Daniel J. Abadi and Adam Marcus and Samuel Madden and Kate Hollenbach},
Journal = VLDBJ,
Year = {2009},
Bibsource = {DBLP, http://dblp.uni-trier.de},
Date-modified = {2015-03-30 13:11:35 +0000},
Ee = {http://dx.doi.org/10.1007/s00778-008-0125-y}
}
@InProceedings{DBLP:WatDiv,
Title = {Diversified Stress Testing of {RDF} Data Management Systems},
Author = {G{\"{u}}nes Alu{\c{c}} and Olaf Hartig and M. Tamer {\"{O}}zsu and Khuzaima Daudjee},
Booktitle = ISWC14,
Year = {2014},
Bdsk-url-1 = {http://dx.doi.org/10.1007/978-3-319-11964-9_13},
Bibsource = {dblp computer science bibliography, http://dblp.org},
Biburl = {http://dblp.uni-trier.de/rec/bib/conf/semweb/AlucHOD14},
Date-modified = {2015-02-25 16:52:34 +0000},
Timestamp = {Fri, 10 Oct 2014 14:01:06 +0200}
}
@Article{CiteSeerX:SystemR,
Title = {{System R:} Relational Approach to Database Management},
Author = {M. M. Astrahan and Ht. W. Blasgen and D. D. Chamberlin and K. P. Eswaran and J. N. Gray and P. P. Griffiths and W. F. King and R. A. Lorie and J. W. Mehl and G. R. Putzolu and I. L. Traiger and B. W. Wade and V. Watson},
Journal = {ACM Transactions on Database Systems},
Year = {1976},
}
@InProceedings{DBLP:conf/sigmod/Atre15,
Title = {\emph{Left Bit Right}: {For SPARQL Join Queries with OPTIONAL Patterns
(Left-outer-joins)}},
Author = {Medha Atre},
Booktitle = SIGMOD,
Year = {2015},
Bibsource = {dblp computer science bibliography, http://dblp.org},
Biburl = {http://dblp.uni-trier.de/rec/bib/conf/sigmod/Atre15},
Doi = {10.1145/2723372.2746483},
Timestamp = {Thu, 28 May 2015 08:59:02 +0200},
Url = {http://doi.acm.org/10.1145/2723372.2746483}
}
@Article{Berners2001THE,
Title = {THE SEMANTIC WEB.},
Author = {Berners-Lee, Tim and Hendler, James and Lassila, Ora},
Journal = {Scientific American},
Year = {2001},
}
@Article{Berners2001The,
Title = {The Semantic Web: A New Form of Web Content That is Meaningful to Computers Will Unleash a Revolution of New Possibilities},
Author = {Berners-Lee, Tim and Hendler, James and Lassila, Ora and Berners-Lee, Tim},
Journal = {Scientific American},
Year = {2001},
}
@Book{cormen1990introduction,
Title = {Introduction to algorithms},
Author = {Cormen, Thomas H and Leiserson, Charles E and Rivest, Ronald L},
Publisher = {MIT press},
Year = {1990}
}
@InProceedings{Decker2003,
Title = {The Semantic Web: Semantics for Data on the Web},
Author = {Decker, Stefan and Kashyap, Vipul},
Booktitle = Proceedings # {2003} # VLDB # Conference,
Year = {2003},
}
@InProceedings{Decker2003The,
Title = {The semantic web: semantics for data on the web},
Author = {Decker, Stefan and Kashyap, Vipul},
Booktitle = {International Conference on Very Large Data Bases},
Year = {2003},
}
@Article{DBLP:journals/rsa/DyerG00,
Title = {The Complexity of Counting Graph Homomorphisms},
Author = {Martin E. Dyer and
Catherine S. Greenhill},
Journal = {Random Struct. Algorithms},
Year = {2000},
Bibsource = {dblp computer science bibliography, http://dblp.org},
Biburl = {http://dblp.uni-trier.de/rec/bib/journals/rsa/DyerG00},
Timestamp = {Sat, 14 Apr 2012 16:35:22 +0200},
Url = {http://onlinelibrary.wiley.com/doi/10.1002/1098-2418(200010/12)17:3/4<260::AID-RSA5>3.0.CO;2-W/abstract}
}
@InProceedings{DBLP:conf/icde/FenderM11,
Title = {A New, Highly Efficient, and Easy to Implement Top-down Join Enumeration
Algorithm},
Author = {Pit Fender and
Guido Moerkotte},
Booktitle = ICDE11,
Year = {2011},
Bibsource = {dblp computer science bibliography, http://dblp.org},
Biburl = {http://dblp.uni-trier.de/rec/bib/conf/icde/FenderM11},
Doi = {10.1109/ICDE.2011.5767901},
Timestamp = {Sat, 09 Aug 2014 14:37:16 +0200},
Url = {http://dx.doi.org/10.1109/ICDE.2011.5767901}
}
@InProceedings{Vijay2016Querying,
Title = {Querying RDF Data Using A Multigraph-based Approach},
Author = {Vijay Ingalalli and Dino Ienco and Pascal Poncelet and Serena Villata},
Booktitle = {EDBT},
Year = {2016}
}
@Article{Klyne2004Resource,
Title = {Resource Description Framework (RDF): Concepts and Abstract Syntax},
Author = {Klyne and Graham and Carroll and Jeremy, J and McBride and Brian},
Journal = {World Wide Web Consortium Recommendation},
Year = {2004}
}
@Article{Kopecky2007Semantic,
Title = {Semantic Annotations for WSDL and XML Schema},
Author = {Kopecky, J. and Vitvar, T. and Bournez, C. and Farrell, J.},
Journal = {IEEE Internet Computing},
Year = {2007},
}
@Article{Martens2006Expressiveness,
Title = {Expressiveness and complexity of XML Schema},
Author = {Martens, Wim and Neven, Frank and Schwentick, Thomas and Bex, Geert Jan},
Journal = {Acm Transactions on Database Systems},
Year = {2006},
}
@Article{DBLP:rdf3x,
Title = {{RDF-3X}: a {RISC}-style engine for {RDF}},
Author = {Thomas Neumann and Gerhard Weikum},
Journal = PVLDB,
Year = {2008},
Bibsource = {DBLP, http://dblp.uni-trier.de},
Date-added = {2015-03-30 01:16:48 +0000},
Date-modified = {2015-03-30 01:16:48 +0000},
Ee = {http://www.vldb.org/pvldb/1/1453927.pdf}
}
@Article{DBLP:journals/tods/PerezAG09,
Title = {Semantics and complexity of {SPARQL}},
Author = {Jorge P{\'{e}}rez and Marcelo Arenas and Claudio Gutierrez},
Journal = TODS,
Year = {2009},
Date-added = {2015-03-30 01:16:48 +0000},
Date-modified = {2015-03-30 01:16:48 +0000}
}
@Article{DBLP:journals/vldb/PengZO0Z16,
Title = {Processing {SPARQL} queries over distributed {RDF} graphs},
Author = {Peng Peng and
Lei Zou and
M. Tamer {\"{O}}zsu and
Lei Chen and
Dongyan Zhao},
Journal = {{VLDB} J.},
Year = {2016},
Bibsource = {dblp computer science bibliography, http://dblp.org},
Biburl = {http://dblp.uni-trier.de/rec/bib/journals/vldb/PengZO0Z16},
Doi = {10.1007/s00778-015-0415-0},
Timestamp = {Mon, 21 Mar 2016 17:08:54 +0100},
Url = {http://dx.doi.org/10.1007/s00778-015-0415-0}
}
@Article{Prud2008SPARQL,
Title = {SPARQL Query Language for RDF},
Author = {Prud'Hommeaux, Eric and Seaborne, Andy},
Journal = {W3C Recommendation},
Year = {2008}
}
@InProceedings{DBLP:FedBench,
Title = {{FedBench: A} Benchmark Suite for Federated Semantic Data Query Processing},
Author = {Michael Schmidt and
Olaf G{\"{o}}rlitz and
Peter Haase and
G{\"{u}}nter Ladwig and
Andreas Schwarte and
Thanh Tran},
Booktitle = ISWC11,
Year = {2011},
Bibsource = {dblp computer science bibliography, http://dblp.org},
Biburl = {http://dblp.uni-trier.de/rec/bib/conf/semweb/SchmidtGHLST11},
Doi = {10.1007/978-3-642-25073-6_37},
Timestamp = {Wed, 19 Oct 2011 14:01:40 +0200},
Url = {http://dx.doi.org/10.1007/978-3-642-25073-6_37}
}
@InProceedings{DBLP:FedX,
Title = {{FedX}: Optimization Techniques for Federated Query Processing on Linked
Data},
Author = {Andreas Schwarte and
Peter Haase and
Katja Hose and
Ralf Schenkel and
Michael Schmidt},
Booktitle = ISWC11,
Year = {2011},
Bibsource = {dblp computer science bibliography, http://dblp.org},
Biburl = {http://dblp.uni-trier.de/rec/bib/conf/semweb/SchwarteHHSS11},
Doi = {10.1007/978-3-642-25073-6_38},
Timestamp = {Wed, 19 Oct 2011 14:01:40 +0200},
Url = {http://dx.doi.org/10.1007/978-3-642-25073-6_38}
}
@Article{VLDB08:QuickSI,
Title = {Taming verification hardness: an efficient algorithm for testing subgraph isomorphism},
Author = {Haichuan Shang and Ying Zhang and Xuemin Lin and Jeffrey Xu Yu},
Journal = PVLDB,
Year = {2008},
Bibsource = {DBLP, http://dblp.uni-trier.de},
Date-added = {2015-03-30 01:16:48 +0000},
Date-modified = {2015-03-30 01:16:48 +0000},
Ee = {http://www.vldb.org/pvldb/1/1453899.pdf}
}
@InProceedings{SIGMOD13:Trinity,
Title = {Trinity: a distributed graph engine on a memory cloud},
Author = {Bin Shao and Haixun Wang and Yatao Li},
Booktitle = SIGMOD,
Year = {2013},
Bibsource = {DBLP, http://dblp.uni-trier.de},
Date-added = {2015-03-30 01:16:48 +0000},
Date-modified = {2015-03-30 01:16:48 +0000},
Ee = {http://doi.acm.org/10.1145/2463676.2467799}
}
@Article{Swick1999Resource,
Title = {Resource Description Framework (RDF) Model and Syntax Specification},
Author = {Swick, Ralph R.},
Journal = {World Wide Web Consortium Recommendation},
Year = {1999}
}
@Article{DBLP:journals/pvldb/ZengYWSW13,
Title = {A Distributed Graph Engine for Web Scale {RDF} Data},
Author = {Kai Zeng and
Jiacheng Yang and
Haixun Wang and
Bin Shao and
Zhongyuan Wang},
Journal = {{PVLDB}},
Year = {2013},
Bibsource = {dblp computer science bibliography, http://dblp.org},
Biburl = {http://dblp.uni-trier.de/rec/bib/journals/pvldb/ZengYWSW13},
Timestamp = {Wed, 04 Sep 2013 08:33:42 +0200},
Url = {http://www.vldb.org/pvldb/vol6/p265-zeng.pdf}
}
@Article{VLDB13:Trinity,
Title = {A Distributed Graph Engine for Web Scale {RDF} Data},
Author = {Kai Zeng and Jiacheng Yang and Haixun Wang and Bin Shao and Zhongyuan Wang},
Journal = PVLDB,
Year = {2013},
Bibsource = {DBLP, http://dblp.uni-trier.de},
Date-added = {2015-03-30 01:16:48 +0000},
Date-modified = {2015-03-30 01:16:48 +0000},
Ee = {http://www.vldb.org/pvldb/vol6/p265-zeng.pdf}
}
@Article{Zou:2013fk,
Title = {{gStore}: A Graph-based {SPARQL} Query Engine},
Author = {Zou, Lei and {\"O}zsu, M. Tamer and Chen, Lei and Shen, Xuchuan and Huang, Ruizhe and Zhao, Dongyan},
Journal = VLDBJ,
Year = {2014},
Date-added = {2015-03-30 01:16:48 +0000},
Date-modified = {2015-03-30 01:16:48 +0000},
Keywords = {RDF, Graph Database}
}
@Article{VLDB11:gStore,
Title = {Answering pattern match queries in large graph databases via graph embedding},
Author = {Lei Zou and M. Tamer {\"O}zsu and Lei Chen and Xuchuan Shen and Ruizhe Huang and Dongyan Zhao},
Journal = VLDBJ,
Year = {2013},
Bibsource = {DBLP, http://dblp.uni-trier.de},
Date-added = {2015-03-30 01:16:48 +0000},
Date-modified = {2015-03-30 01:16:48 +0000},
Ee = {http://dx.doi.org/10.1007/s00778-011-0238-6}
}