バージョン 17 から バージョン 18 における更新: OwlimSe

差分発生行の前後
無視リスト:
更新日時:
2012/08/20 10:01:52 (12 年 前)
更新者:
wu
コメント:

--

凡例:

変更なし
追加
削除
変更
  • OwlimSe

    v17 v18  
    1717It is well known that the construction of index can help accelerate the query but make the update slow. In OwlimSE, we make cache-memory = tuple-index-memory, namely, we enable POS/PSO indices but disable PCSOT,PTSOC,SP, PO indices and full-text search. By setting build-pcsot,build-ptsoc,ftsIndexPolicy,enablePredicateList to true or some appropriate value("onCommit", "onStartup" or "onShutdown" for ftsIndexPolicy) we can enable them accordingly. 
    1818 
    19 About Owlim-SE index: 
    20  
    21  
    22 {{{ 
    23 -Xmx60G -Xms30G -Druleset=empty -Dentity-index-size=675000000 -Dcache-memory=20633m  -DenablePredicateList=false -Dtuple-index-memory=20633m -DftsIndexPolicy=never  -Dbuild-pcsot=false -Dbuild-ptsoc=false  -Djournaling=true -Drepository-type=file-repository   -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -Dentity-id-size=32   
    24  
    25 }}} 
     19 
    2620 
    2721More information please refer to [http://owlim.ontotext.com/display/OWLIMv43/OWLIM-SE+Configuration]  
     
    8175(Please refer to [https://github.com/JervenBolleman/sesame-loader/] for details) 
    8276 
     77About Owlim-SE index: 
     78 
     79when: 
     80{{{ 
     81-Xmx60G -Xms30G -Druleset=empty -Dentity-index-size=675000000 -Dcache-memory=20633m  -DenablePredicateList=false -Dtuple-index-memory=20633m -DftsIndexPolicy=never  -Dbuild-pcsot=false -Dbuild-ptsoc=false  -Djournaling=true -Drepository-type=file-repository   -XX:+UseG1GC -XX:+HeapDumpOnOutOfMemoryError -Dentity-id-size=32   
     82 
     83}}} 
     84 
     85and we use 12 threads to import, it took 68 hours and 29 minutes.        
     86 
     87when  
     88 
     89{{{ 
     90 -Xmx60G -Xms30G -Druleset=empty -Dentity-index-size=800000000 -Dcache-memory=20000m  -DenablePredicateList=false -Dtuple-index-memory=20000m -DftsIndexPolicy=never  -Dbuild-pcsot=false -Dbuild-ptsoc=false  -Djournaling=true -Drepository-type=file-repository -Dowlim-license=$CATALINA_HOME/OWLIM_SE.license   -XX:+HeapDumpOnOutOfMemoryError -Dentity-id-size=32 
     91}}} 
     92 
     93and we use 3 threads to import, it took 59 hours and 15 minutes. 
     94 
    8395=== Allie upload === #allieload  
    8496