バージョン 20 から バージョン 21 における更新: OwlimSe

差分発生行の前後
無視リスト:
更新日時:
2012/08/27 10:31:24 (12 年 前)
更新者:
wu
コメント:

--

凡例:

変更なし
追加
削除
変更

  • OwlimSe

    v20 v21  
    9494-Xmx60G -Xms30G -Druleset=empty -Dentity-index-size=675000000 -Dcache-memory=20633m  -DenablePredicateList=false -Dtuple-index-memory=20633m -DftsIndexPolicy=never  -Dbuild-pcsot=false -Dbuild-ptsoc=false  -Djournaling=true -Drepository-type=file-repository   -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -Dentity-id-size=32   
    9595 
     96}}} and vm.swappiness=60, 
     97 
     98 we used 12 threads to import, it took 68 hours and 29 minutes.          
     99 
     100when  
     101 
     102{{{ 
     103 -Xmx60G -Xms30G -Druleset=empty -Dentity-index-size=800000000 -Dcache-memory=20000m  -DenablePredicateList=false -Dtuple-index-memory=20000m -DftsIndexPolicy=never  -Dbuild-pcsot=false -Dbuild-ptsoc=false  -Djournaling=true -Drepository-type=file-repository  -XX:+HeapDumpOnOutOfMemoryError -Dentity-id-size=32 
     104}}} and vm.swappiness=60, 
     105 
     106 we used 3 threads to import, it took 59 hours and 15 minutes. 
     107 
     108 
     109 
     110=== DDBJ upload === #ddbjload   
     111 
     112when 
     113{{{ 
     114-Xmx60G -Xms30G -Druleset=empty -Dentity-index-size=675000000 -Dcache-memory=20633m  -DenablePredicateList=false -Dtuple-index-memory=20633m -DftsIndexPolicy=never  -Dbuild-pcsot=false -Dbuild-ptsoc=false  -Djournaling=true -Drepository-type=file-repository   -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -Dentity-id-size=32   
     115 
    96116}}} 
    97117 
    98 and we used 12 threads to import, it took 68 hours and 29 minutes.       
     118and we used 12 threads to import, it took 128hours15minutes and an outofMemory occurred at the end. And we took another 54hours and 53minutes to do a data restore for using the database.  
    99119 
    100120when  
    … …  
    104124}}} 
    105125 
    106 and we used 3 threads to import, it took 59 hours and 15 minutes. 
    107  
    108 === DDBJ upload === #ddbjload   
    109  
    110 when 
    111 {{{ 
    112 -Xmx60G -Xms30G -Druleset=empty -Dentity-index-size=675000000 -Dcache-memory=20633m  -DenablePredicateList=false -Dtuple-index-memory=20633m -DftsIndexPolicy=never  -Dbuild-pcsot=false -Dbuild-ptsoc=false  -Djournaling=true -Drepository-type=file-repository   -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -Dentity-id-size=32   
    113  
    114 }}} 
    115  
    116 and we used 12 threads to import, it took 128hours15minutes and an outofMemory occurred at the end. And we took another 54hours and 53minutes to do a data restore for using the database.  
    117  
    118 when  
    119  
    120 {{{ 
    121  -Xmx60G -Xms30G -Druleset=empty -Dentity-index-size=800000000 -Dcache-memory=20000m  -DenablePredicateList=false -Dtuple-index-memory=20000m -DftsIndexPolicy=never  -Dbuild-pcsot=false -Dbuild-ptsoc=false  -Djournaling=true -Drepository-type=file-repository  -XX:+HeapDumpOnOutOfMemoryError -Dentity-id-size=32 
    122 }}} 
    123  
    124126and we use 3 threads to import, it took 82hours and 2 minutes successfully to import DDBJ.  
    125127 
     128when vm.swappiness=10,  
     129 
     130it took 49 hours and 12 minutes. 
     131 
     132 
     133'''Load performance''' 
    126134 
    127135 
    128136||loadtime|| Cell Cycle Ontology || Allie || PDBj || UniProt || DDBJ || 
    129 || 1st time || 3mins || 28mins ||197mins  ||3555mins  ||4922mins  || 
     137|| 1st time || 3mins || 28mins ||197mins  ||3555mins  ||2952mins  || 
    130138|| 2nd time || 3mins || 30mins ||219mins  ||  ||  || 
    131139|| average || 3mins || 29mins ||208mins  ||  || ||