-
Started:
April 16, 2024 17:41
-
Completed:
10:05:13
-
Failed:
No.
-
Status:
completed
Events (most recent first):
-
22:02:32
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 1792000; Traits: 1790878; MetaData: 0
-
22:01:06
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_14.csv
-
21:33:00
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 28 minutes for the part 14 of 24 to be added to neo4j.
-
21:33:00
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 1664000; Traits: 1662878; MetaData: 0
-
21:31:28
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_13.csv
-
21:05:23
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 26 minutes for the part 13 of 24 to be added to neo4j.
-
21:05:23
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 1536000; Traits: 1534878; MetaData: 0
-
21:03:55
(warns)
each.rb:9:in `each'> slurp.rb:289:in `rescue in block (2 levels) in load_csv'> ...re-trying.
-
20:58:55
(warns)
each.rb:9:in `each'> slurp.rb:285:in `rescue in block (2 levels) in load_csv'> FAILED on build_nodes query (Trait), will re-try 3 times after 5 minute pause (the site may be too busy to serve the CSV to Neo4j)...
-
20:58:55
(warns)
each.rb:9:in `each'> slurp.rb:284:in `rescue in block (2 levels) in load_csv'> Couldn't load the external resource at: https://eol.org/data/Globi/publish_traits_chunk_12.csv
-
20:58:55
(warns)
each.rb:9:in `each'> slurp.rb:571:in `rescue in autocommit_query'> Exception (Neo4j::Driver::Exceptions::ClientException) QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/Globi/publish_traits_chunk_12.csv' AS row WITH row WHERE 1=1 MERGE (trait:Trait { eol_pk: row.eol_pk })
ON CREATE SET trait.resource_pk = row.resource_pk
ON MATCH SET trait.resource_pk = row.resource_pk
ON CREATE SET trait.source = row.source
ON MATCH SET trait.source = row.source
ON CREATE SET trait.literal = row.literal
ON MATCH SET trait.literal = row.literal
ON CREATE SET trait.measurement = row.measurement
ON MATCH SET trait.measurement = row.measurement
ON CREATE SET trait.scientific_name = row.scientific_name
ON MATCH SET trait.scientific_name = row.scientific_name
ON CREATE SET trait.normal_measurement = row.normal_measurement
ON MATCH SET trait.normal_measurement = row.normal_measurement
ON CREATE SET trait.sample_size = row.sample_size
ON MATCH SET trait.sample_size = row.sample_size
ON CREATE SET trait.citation = row.citation
ON MATCH SET trait.citation = row.citation
ON CREATE SET trait.remarks = row.remarks
ON MATCH SET trait.remarks = row.remarks
ON CREATE SET trait.method = row.method
ON MATCH SET trait.method = row.method} MESSAGE: Couldn't load the external resource at: https://eol.org/data/Globi/publish_traits_chunk_12.csv
-
20:58:51
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_12.csv
-
20:34:46
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 24 minutes for the part 12 of 24 to be added to neo4j.
-
20:34:46
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 1408000; Traits: 1408000; MetaData: 0
-
20:33:01
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_11.csv
-
20:10:55
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 22 minutes for the part 11 of 24 to be added to neo4j.
-
20:10:55
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 1280000; Traits: 1280000; MetaData: 0
-
20:09:23
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_10.csv
-
19:49:20
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 20 minutes for the part 10 of 24 to be added to neo4j.
-
19:49:20
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 1152000; Traits: 1152000; MetaData: 0
-
19:47:48
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_9.csv
-
19:29:45
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 18 minutes for the part 9 of 24 to be added to neo4j.
-
19:29:45
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 1024000; Traits: 1024000; MetaData: 0
-
19:28:28
(warns)
each.rb:9:in `each'> slurp.rb:289:in `rescue in block (2 levels) in load_csv'> ...re-trying.
-
19:23:28
(warns)
each.rb:9:in `each'> slurp.rb:285:in `rescue in block (2 levels) in load_csv'> FAILED on build_nodes query (Page), will re-try 2 times after 5 minute pause (the site may be too busy to serve the CSV to Neo4j)...
-
19:23:28
(warns)
each.rb:9:in `each'> slurp.rb:284:in `rescue in block (2 levels) in load_csv'> Couldn't load the external resource at: https://eol.org/data/Globi/publish_traits_chunk_8.csv
-
19:23:28
(warns)
each.rb:9:in `each'> slurp.rb:571:in `rescue in autocommit_query'> Exception (Neo4j::Driver::Exceptions::ClientException) QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/Globi/publish_traits_chunk_8.csv' AS row WITH row WHERE 1=1 MERGE (page:Page { page_id: toInteger(row.page_id) })} MESSAGE: Couldn't load the external resource at: https://eol.org/data/Globi/publish_traits_chunk_8.csv
-
19:23:26
(warns)
each.rb:9:in `each'> slurp.rb:289:in `rescue in block (2 levels) in load_csv'> ...re-trying.
-
19:18:26
(warns)
each.rb:9:in `each'> slurp.rb:285:in `rescue in block (2 levels) in load_csv'> FAILED on build_nodes query (Page), will re-try 3 times after 5 minute pause (the site may be too busy to serve the CSV to Neo4j)...
-
19:18:26
(warns)
each.rb:9:in `each'> slurp.rb:284:in `rescue in block (2 levels) in load_csv'> Couldn't load the external resource at: https://eol.org/data/Globi/publish_traits_chunk_8.csv
-
19:18:26
(warns)
each.rb:9:in `each'> slurp.rb:571:in `rescue in autocommit_query'> Exception (Neo4j::Driver::Exceptions::ClientException) QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'https://eol.org/data/Globi/publish_traits_chunk_8.csv' AS row WITH row WHERE 1=1 MERGE (page:Page { page_id: toInteger(row.page_id) })} MESSAGE: Couldn't load the external resource at: https://eol.org/data/Globi/publish_traits_chunk_8.csv
-
19:18:25
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_8.csv
-
19:02:22
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 16 minutes for the part 8 of 24 to be added to neo4j.
-
19:02:22
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 896000; Traits: 896000; MetaData: 0
-
19:00:54
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_7.csv
-
18:46:49
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 14 minutes for the part 7 of 24 to be added to neo4j.
-
18:46:49
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 768000; Traits: 768000; MetaData: 0
-
18:45:29
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_6.csv
-
18:33:26
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 12 minutes for the part 6 of 24 to be added to neo4j.
-
18:33:26
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 640000; Traits: 640000; MetaData: 0
-
18:31:54
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_5.csv
-
18:21:51
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 10 minutes for the part 5 of 24 to be added to neo4j.
-
18:21:51
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 512000; Traits: 512000; MetaData: 0
-
18:20:20
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_4.csv
-
18:12:18
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 8 minutes for the part 4 of 24 to be added to neo4j.
-
18:12:18
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 384000; Traits: 384000; MetaData: 0
-
18:10:53
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_3.csv
-
18:04:51
(infos)
each.rb:9:in `each'> slurp.rb:329:in `block in break_up_large_file'> Waiting 6 minutes for the part 3 of 24 to be added to neo4j.
-
18:04:51
(infos)
each.rb:9:in `each'> slurp.rb:351:in `log_node_count'> Nodes: 256000; Traits: 256000; MetaData: 0
-
18:03:27
(infos)
each.rb:9:in `each'> slurp.rb:275:in `block in load_csv'> Importing 128000 rows from publish_traits_chunk_2.csv
