dcsimg
 
  en  
names in breadcrumbs

Import Log for BHL data coverage

  • Started: September 03, 2024 12:07
  • Completed: 10:22:39
  • Failed: 10:22:39
  • Status: NOT PART OF CHAIN! RelationshipTraversalCursor[id=7217026, open state with: denseNode=false, next=7217026, , underlying record=Relationship[7217026,used=true,source=14222994,target=10366943,type=0,sCount=18,sNext=59115462,tPrev=9485276,tNext=-1,prop=-

Events (most recent first):

show warnings (11)
  • 10:22:39 (ends) Complete delayed_job:71>base:81>delayed_job:21>resource:229>fast:10,177
  • 10:22:39 (ends) TOTAL TIME: 57.7m delayed_job:71>base:81>delayed_job:21>resource:229>fast:10,176
  • 10:22:39 (errors) Manual failure called, process must have died. (NOT PART OF CHAIN! RelationshipTraversalCursor[id=7217026, open state with: denseNode=false, next=7217026, , underlying record=Relationship[7217026,used=true,source=14222994,target=10366943,type=0,sCount=18,sNext=59115462,tPrev=9485276,tNext=-1,prop=-) base:81>delayed_job:21>resource:229>fast:10,172,174
  • 10:22:39 (warns) Trait Publishing failed: NOT PART OF CHAIN! RelationshipTraversalCursor[id=7217026, open state with: denseNode=false, next=7217026, , underlying record=Relationship[7217026,used=true,source=14222994,target=10366943,type=0,sCount=18,sNext=59115462,tPrev=9485276,tNext=-1,prop=-1, sFirst,!tFirst]] FROM /gems/ruby/3.3.0/bundler/gems/neo4j-ruby-driver-fe5438fb945d/ffi/neo4j/driver/internal/handlers/response_handler.rb:38:in `check_summary_failure' << /app/lib/trait_bank/slurp.rb:536:in `merge_triple' << /app/lib/trait_bank/slurp.rb:421:in `block in load_csv_where' << /app/lib/trait_bank/slurp.rb:421:in `each' << /app/lib/trait_bank/slurp.rb:421:in `load_csv_where' << /app/lib/trait_bank/slurp.rb:297:in `block (2 levels) in load_csv' delayed_job:21>resource:229>fast:10,160,203,207
  • 10:22:39 (warns) Exception (Neo4j::Driver::Exceptions::DatabaseException) FROM: #merge_triple QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'http://10.252.248.42:8080/data/bhl_data_coverag/publish_traits_chunk_1.csv' AS row WITH row WHERE 1=1 MATCH (page:Page { page_id: toInteger(row.page_id) }) MATCH (trait:Trait { eol_pk: row.eol_pk })} slurp:297,421,421,421,535,538
  • 10:22:39 (warns) Exception (Neo4j::Driver::Exceptions::DatabaseException) QUERY: {USING PERIODIC COMMIT LOAD CSV WITH HEADERS FROM 'http://10.252.248.42:8080/data/bhl_data_coverag/publish_traits_chunk_1.csv' AS row WITH row WHERE 1=1 MATCH (page:Page { page_id: toInteger(row.page_id) }) MATCH (trait:Trait { eol_pk: row.eol_pk }) MERGE (page)-[:trait]->(trait)} MESSAGE: NOT PART OF CHAIN! RelationshipTraversalCursor[id=7217026, open state with: denseNode=false, next=7217026, , underlying record=Relationship[7217026,used=true,source=14222994,target=10366943,type=0,sCount=18,sNext=59115462,tPrev=9485276,tNext=-1,prop=-1, sFirst,!tFirst]] slurp:421,421,421,536,566,574
  • 10:22:33 (infos) Importing 99001 rows from publish_traits_chunk_1.csv slurp:324>each:9,9>slurp:338,311,276
  • 10:22:33 (warns) Found 3470738 rows, will break up into 36 of 99000 fast:204,335>slurp:30,586,274,309
  • 10:22:32 (infos) adding new traits fast:10,160,204,335>slurp:30,585
  • 10:22:32 (infos) not removing any traits fast:10,160,204,335>slurp:29,614
  • 10:22:04 (infos) polling for trait diff metadata: /resources/1223/publish_diffs.json fast:204,335>slurp:20>content_server_connection:38,156,83
  • 10:22:04 (starts) #publish_traits = TraitBank::Slurp.load_resource_from_repo base:81>delayed_job:21>resource:229>fast:10,160,202
  • 10:22:04 (warns) There were NO new pages, skipping... base:81>delayed_job:21>resource:229>fast:10,155>page_creator:22
  • 10:16:58 (starts) create_new_pages base:81>delayed_job:21>resource:229>fast:10,155>page_creator:5
  • 10:16:45 (starts) PageCreator delayed_job:71>base:81>delayed_job:21>resource:229>fast:10,154
  • 10:16:45 (starts) restoring vernacular preferences... delayed_job:71>base:81>delayed_job:21>resource:229>fast:10,150
  • 10:16:45 (starts) #grab_file content_sections.tsv fast:10,149,149,149,225,246
  • 10:16:45 (starts) #import_and_prop_ids ContentSection resource:229>fast:10,149,149,149,223
  • 10:16:45 (starts) #grab_file references.tsv fast:10,149,149,149,225,246
  • 10:16:45 (starts) #import_and_prop_ids Reference resource:229>fast:10,149,149,149,223
  • 10:16:45 (starts) #grab_file image_info.tsv fast:10,149,149,149,225,246
  • 10:16:45 (starts) #import_and_prop_ids ImageInfo resource:229>fast:10,149,149,149,223
  • 10:16:45 (starts) #grab_file attributions.tsv fast:10,149,149,149,225,246
  • 10:16:45 (starts) #import_and_prop_ids Attribution resource:229>fast:10,149,149,149,223
  • 10:16:45 (starts) #grab_file media.tsv fast:10,149,149,149,225,246
  • 10:16:45 (starts) #import_and_prop_ids Medium resource:229>fast:10,149,149,149,223
  • 10:16:45 (starts) #grab_file articles.tsv fast:10,149,149,149,225,246
  • 10:16:45 (starts) #import_and_prop_ids Article resource:229>fast:10,149,149,149,223
  • 10:16:45 (starts) #grab_file vernaculars.tsv fast:10,149,149,149,225,246
  • 10:16:45 (starts) #import_and_prop_ids Vernacular resource:229>fast:10,149,149,149,223
  • 10:16:45 (starts) #grab_file node_ancestors.tsv fast:10,149,149,149,225,246
  • 10:16:45 (starts) #import_and_prop_ids NodeAncestor resource:229>fast:10,149,149,149,223
  • 10:14:19 (starts) #propagate_ids ScientificName fast:10,149,149,149,227,283
  • 10:02:54 (starts) #import ScientificName fast:10,149,149,149,226,255
  • 10:01:49 (starts) #grab_file scientific_names.tsv fast:10,149,149,149,225,246
  • 10:01:49 (starts) #import_and_prop_ids ScientificName resource:229>fast:10,149,149,149,223
  • 10:01:49 (starts) #grab_file identifiers.tsv fast:10,149,149,149,225,246
  • 10:01:49 (starts) #import_and_prop_ids Identifier resource:229>fast:10,149,149,149,223
  • 10:01:49 (starts) #grab_file bibliographic_citations.tsv fast:10,149,149,149,225,246
  • 10:01:49 (starts) #import_and_prop_ids BibliographicCitation resource:229>fast:10,149,149,149,223
  • 10:01:44 (starts) #propagate_ids Node fast:10,149,149,149,227,283
  • 09:58:06 (starts) #import Node fast:10,149,149,149,226,255
  • 09:57:37 (starts) #grab_file nodes.tsv fast:10,149,149,149,225,246
  • 09:57:37 (starts) #import_and_prop_ids Node resource:229>fast:10,149,149,149,223
  • 09:57:37 (starts) #grab_file referents.tsv fast:10,149,149,149,225,246
  • 09:57:37 (starts) #import_and_prop_ids Referent resource:229>fast:10,149,149,149,223
  • 09:57:37 (warns) All existing content has been destroyed for the resource. delayed_job:71>base:81>delayed_job:21>resource:229>fast:10,143
  • 09:57:37 (infos) Removed 3470737 Nodes resource:229>fast:10,135>resource:274,338,306
  • 09:42:28 (updates) Batch 347 (expect 348 batches, maximum 696)...
  • 09:42:28 (infos) Starting (this log message should be replaced shortly) resource:229>fast:10,135>resource:274,322,306
EOL is hosted by: