バージョン 24 から バージョン 25 における更新: bigdata

更新日時:

2012/08/08 12:36:29 (12 年 前)

更新者:

wu

コメント:

--

bigdata

@@ -61 +61 @@
             38 minutes with automatic garbage collection (vm.swappiness =60);
 
-Approach 4: 1.03 hours with collecting garbage;
+Approach 4: 1.03 hours with UseG1GC;
             35 minutes with automatic garbage collection;
 
@@ -73 +73 @@
 === Uniprot upload === #uniprotload 
 
-time: over one week(7.48 days): 646336127ms
+'''uniprot.rdf.gz'''
+
+We firstly uploaded the file uniprot.rdf.gz (3.16 billion triples):
+
+time: over one week(7.48 days): 646336127ms with UseG1GC
 
 INFO : 646335942 main com.bigdata.rdf.store.DataLoader?.logCounters(DataLoader?.java:1185): extent=249818775552, stmts=3161144450, bytes/stat=79 Wrote: 241474404352 bytes. Total elapsed=646336127ms
 
-Without collecting garbage： 74.3hours(4458 minutes)
+with automatic garbage collection： 74.3hours(4458 minutes)
 
  INFO : 267385254      main com.bigdata.rdf.store.DataLoader.logCounters(DataLoader.java:1185): extent=249818775552, stmts=3161144450, bytes/stat=79
 Wrote: 241489608704 bytes.
 Total elapsed=267385843ms
+
+'''uniparc.rdf.gz'''
+
+When added the file uniparc.rdf.gz, which had been successfully imported by OWLIM-SE and Virtuoso, the following error occurred:
+
+[Fatal Error] purl.uniprot.org:382336302:72: Premature end of file.
+Exception in thread "main" java.lang.reflect.InvocationTargetException
+        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
+        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
+        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
+        at java.lang.reflect.Method.invoke(Method.java:597)
+        at org.eclipse.jdt.internal.jarinjarloader.JarRsrcLoader.main(JarRsrcLoader.java:58)
+Caused by: java.lang.RuntimeException: While loading: /opt/services/togordf/data/uniprot/uniprotgz/uniparc.rdf.gz
+        at com.bigdata.rdf.store.DataLoader.loadFiles(DataLoader.java:939)
+        at com.bigdata.rdf.store.DataLoader.main(DataLoader.java:1469)
+        ... 5 more
 
 === Load performance ===