バージョン 18 から バージョン 19 における更新: OwlimSe

差分発生行の前後
無視リスト:
更新日時:
2012/08/20 10:05:46 (12 年 前)
更新者:
wu
コメント:

--

凡例:

変更なし
追加
削除
変更

  • OwlimSe

    v18 v19  
    7575(Please refer to [https://github.com/JervenBolleman/sesame-loader/] for details) 
    7676 
    77 About Owlim-SE index: 
    78  
    79 when: 
     77 
     78 
     79=== Allie upload === #allieload  
     80 
     81Approach 1:  38 minutes 
     82 
     83Approach 2:  28 minutes 
     84 
     85=== PDBJ upload === #pdbjload  
     86 
     87Approach 2:  197mins 
     88 
     89=== Uniprot upload === #uniprotload  
     90 
     91 
     92when 
    8093{{{ 
    8194-Xmx60G -Xms30G -Druleset=empty -Dentity-index-size=675000000 -Dcache-memory=20633m  -DenablePredicateList=false -Dtuple-index-memory=20633m -DftsIndexPolicy=never  -Dbuild-pcsot=false -Dbuild-ptsoc=false  -Djournaling=true -Drepository-type=file-repository   -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -Dentity-id-size=32   
    … …  
    88101 
    89102{{{ 
    90  -Xmx60G -Xms30G -Druleset=empty -Dentity-index-size=800000000 -Dcache-memory=20000m  -DenablePredicateList=false -Dtuple-index-memory=20000m -DftsIndexPolicy=never  -Dbuild-pcsot=false -Dbuild-ptsoc=false  -Djournaling=true -Drepository-type=file-repository -Dowlim-license=$CATALINA_HOME/OWLIM_SE.license  -XX:+HeapDumpOnOutOfMemoryError -Dentity-id-size=32 
     103 -Xmx60G -Xms30G -Druleset=empty -Dentity-index-size=800000000 -Dcache-memory=20000m  -DenablePredicateList=false -Dtuple-index-memory=20000m -DftsIndexPolicy=never  -Dbuild-pcsot=false -Dbuild-ptsoc=false  -Djournaling=true -Drepository-type=file-repository -XX:+HeapDumpOnOutOfMemoryError -Dentity-id-size=32 
    91104}}} 
    92105 
    93106and we use 3 threads to import, it took 59 hours and 15 minutes. 
    94107 
    95 === Allie upload === #allieload  
    96  
    97 Approach 1:  38 minutes 
    98  
    99 Approach 2:  28 minutes 
    100  
    101 === PDBJ upload === #pdbjload  
    102  
    103 Approach 2:  197mins 
    104  
    105 === Uniprot upload === #uniprotload  
    106  
    107 uniprot.rdf.gz: 3,161,144,451 triples, about 28 hours  
    108  
    109108=== DDBJ upload === #ddbjload   
    110109 
    111110 
    112111||loadtime|| Cell Cycle Ontology || Allie || PDBj || UniProt || DDBJ || 
    113 || 1st time || 3mins || 28mins ||197mins  ||  ||  || 
     112|| 1st time || 3mins || 28mins ||197mins  ||3555mins  ||  || 
    114113|| 2nd time || 3mins || 30mins ||219mins  ||  ||  || 
    115114|| average || 3mins || 29mins ||208mins  ||  || ||