== Triple Store Survey for Life Science Data ==

    * [#overview Overview]
    * [#platform Platform]
    * [#data Data]
    * [#approach Approach]
    * Database
       * 4store  [wiki:4store => 4store  ]
       * Bigdata [wiki:bigdata => Bigdata ]
       * Mulgara [wiki:Mulgara  => Mulgara ]
       * Owlim-SE [wiki:OwlimSe => OwlimSe  ]     
       * Virtuoso [wiki:Virtuoso => Virtuoso ]
       
  
   
    * Summary  [wiki:summarize =>Summarize]

=== Overview === #overview

We present an evaluation of native triple stores on biological data. Compared with the data in other areas biological data is typically huge. Therefore the performance of bulk loading and querying are essential to decide whether a triple store can be applied into the biological field. Here we test five native triple stores Virtuoso, OwlimSE, Mulgara, 4store, and Bigdata with five biological dataset, which ranging from tens of millions to eight billions. We present their load times and query cost. 

For each database we provide several results by adjusting their parameters, which could influence the performance importantly. However  These parameters could perform differently with different hardware and software platforms, and even with different data set. It is difficult to test all the performance by adjusting and combining all the parameters for every data set because the importing of our data set, such as uniprot and DDBJ, takes over two days or more. Therefore we do not guarantee what we provide is the best performance of each database although we try to find out the best performance for each triple store.

'''4store''' 

4store is a RDF/SPARQL store written in C and designed to run on UNIX-like systems, either single machines or networked clusters. Please refer to [http://4store.org/] for detail.

'''Bigdata'''

Bigdata  is designed as a distributed database architecture running over clusters of 100s to 1000s of commodity machines, but also  can run in a high-performance single-server mode. It supports RDFS and limited OWL inference. Bigdata is written in java and open source. Please refer to [http://sourceforge.net/apps/mediawiki/bigdata/index.php?title=GettingStarted].


'''OwlimSE'''

OwlimSE is a member of OWLIM family, which provides native RDF engines implemented in Java and deliveries full performance through both Sesame and Jena. From OwlimSE 4.3 it begins to support SPARQL 1.1 Federation. It supports for the semantics of RDFS, OWL 2 RL and OWL 2 QL. OwlimSE is only available in commercial license.  Please refer to [http://www.ontotext.com/owlim].

'''Mulgara'''

Mulgara is written entirely in Java and available in open source. Mulgara provides a SQL-like language iTQL(Interactive Tucana Query Language)  shell  to query and update Mulgara databases, which also support RDFS and OWL inferencing.  It also provides a SPARQL query parser and query engine. Please refer to [http://www.mulgara.org/].



'''Virtuoso''' 

Virtuoso provides a triple storage solution for RDF in RDBMS platform. Virtuoso is multi-protocol RDBMS for RDBMS, RDF, XML and so on. It offers stored procedures to load RDFXML, ntriples, and compressed triples and supports for SPARQL.  Virtuoso supports limited RDFS and OWL inferencing. Virtuoso can be run in both standalone and  cluster mode.The function as a standalone triple store server is available in both open source and commercial licenses. Please refer to [http://virtuoso.openlinksw.com/].



=== Platform === #platform 

* Machine:
 * OS:   GNU/linux 
 * CPU:  GenuineIntel 6; model name : Intel(R) Xeon(R) CPU E5649  @ 2.53GHz; 12 cores 24 hyper-threading
 * Mem:  65996128 kB
 * Harddisk: SCSI Raid 0 (three  hard disks of 2 Tera bytes; two of them are used to store data)

* Software: 
  * JDK:1.6.0_26 
  * 4store:  1.1.4
  * Bigdata: RWSTORE_1_1_0 
  * Mulgara: 2.1.12
  * OwlimSE: 4.3.4238
  * Virtuoso: 6.4 commercial

=== Data === #data      

'''Cell cycle''': .rdf (RDFXML) format, 11,315,866 tripples,from [http://www.semantic-systems-biology.org/]. sparql query attachment:cell.txt .

'''Allie''': .n3 format, 94,420,989 tripples, sparql query attachment:allie.txt .

'''PDBJ''': .rdf.gz format ,589,987,335 triples, 77878 files,  from  [ftp://ftp.pdbj.org/XML/rdf/]. sparql query attachment:pdbj.txt.

The queries in PDBJ are point queries which retrieve the relative characteristics of certain EntryID, such as 107L. Therefore their result set is small but the number of query joins is big. 

'''Uniprot''': .rdf.gz format , 4,025,881,829  triples, the 3 larger files are uniprot.rdf.gz,uniparc.rdf.gz,uniref.rdf.gz, from [ftp://ftp.uniprot.org/pub/databases/uniprot/] (the experiment used data was  2011.Nov version). sparql query attachment:uniprot.txt or [http://beta.sparql.uniprot.org/].

'''DDBJ''': .rdf.gz format, 7,902,743,055 triples, 330 files, from [ftp://ftp.ddbj.nig.ac.jp/ddbj_database/ddbj/]. sparql query attachment:ddbj.txt .

=== Approach === #approach
   
   We evaluated the data in every Sparql end point at least twice to make it sure that there is no much difference between two test values:|2nd-1st|/max(2nd,1st)<0.1.
  
   We did the query evaluation by executing the whole query mix (composed of the query sequence) five times in every Sparql endpoint, remove the highest one and then get the average time cost of other four queries. We report the five detailed time cost in  every database section and the average cost in the summary section.