バージョン 13 から バージョン 14 における更新: Virtuoso
- 更新日時:
- 2012/03/07 14:55:42 (13 年 前)
凡例:
- 変更なし
- 追加
- 削除
- 変更
-
Virtuoso
v13 v14 45 45 46 46 === Allie upload === #allieload 47 48 49 '''Data''': 94,420,989 tripples, n3 format. 50 47 51 * Approach 1: 48 52 53 Load the big file in one stream. 54 55 56 '''Result:''' 57 2hours. 58 59 60 Step: 61 62 $ nohup $VIRTUOSO_HOME/bin/isql 1111 dba dba <$VIRTUOSO_HOME/scripts/load.list.isql & 63 64 65 load.list.isql script: 66 67 {{{ 68 log_enable (2); 69 DB.DBA.TTLP (file_to_string_output('file path'),' ','http://mydbcls.jp', 0); 70 checkpoint; 71 }}} 72 49 73 * Approach 2: 50 74 51 75 Use one stream per core (not per core thread). Split the big file into 12 small files(precisely, 13(12+1)files, #linesPerFiles=#totleLines/12). 52 76 53 '''result:'''54 77 55 47mins(94,420,989 tripples, n3).78 '''Result''': 46mins22secs. 56 79 57 80 58 1. load file into ld_dir:81 Step 1. load file into ld_dir: 59 82 60 83 $nohup $VIRTUOSO_HOME/bin/isql 1111 dba dba <$VIRTUOSO_HOME/scripts/load.list.isql & … … 69 92 70 93 71 2. upload the file into virtuoso:94 Step 2. upload the file into virtuoso: 72 95 $ nohup $VIRTUOSO_HOME/bin/isql 1111 dba dba <$VIRTUOSO_HOME/scripts/load.data.isql & 73 96 … … 89 112 90 113 91 46mins22secs 114 115 === PDBJ upload === #pdbjload 92 116 93 117 118 '''Data:''' .rdf.gz, 77878 files, 58,9987,335 triples from 94 119 95 96 === PDBJ upload === #pdbjload 120 '''Result:'''103min31s. 97 121 98 122 === Uniprot upload === #uniprotload
