You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I switched from a login node to an interactive now and now import automation is not correctly making the outputs.
Note this can't be rerun as is b/c it will incorrectly push another data object record to has_output for the data_generation_set record.
/global/cfs/cdirs/m3408/users/nmdcda/repos/clone/nmdc_automation> poetry run python nmdc_automation/run_process/run_import.py import-projects /global/homes/n/nmdcda/m3408/aim2/dev/1000_soils/1000_soils_analysis_projects/ingest_manifest_continue.tsv configs/import.yaml.1 configs/site_configuration.toml
INFO:__main__:Importing project from /global/homes/n/nmdcda/m3408/aim2/dev/1000_soils/1000_soils_analysis_projects/ingest_manifest_continue.tsv
INFO:__main__:Importing nmdc:omprc-12-mm525w16 from /global/cfs/cdirs/m3408/aim2/dev/1000_soils/1000_soils_analysis_projects/Ga0533584
INFO:__main__:Mapping sequencing data
INFO:nmdc_automation.import_automation.activity_mapper:Adding Sequencing data to Map: nmdc:dobj-11-96cke247
INFO:__main__:Mapping single data files
INFO:nmdc_automation.import_automation.activity_mapper:Processing Metagenome Raw Reads
WARNING:root:Import not enabled for nmdc:NucleotideSequencing Metagenome Raw Reads
INFO:nmdc_automation.import_automation.activity_mapper:Processing CheckM Statistics
WARNING:root:Import not enabled for nmdc:MagsAnalysis CheckM Statistics
INFO:nmdc_automation.import_automation.activity_mapper:Processing GTDBTK Bacterial Summary
WARNING:root:Import not enabled for nmdc:MagsAnalysis GTDBTK Bacterial Summary
INFO:nmdc_automation.import_automation.activity_mapper:Processing GTDBTK Archaeal Summary
WARNING:root:Import not enabled for nmdc:MagsAnalysis GTDBTK Archaeal Summary
INFO:nmdc_automation.import_automation.activity_mapper:Processing Annotation Amino Acid FASTA
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Annotation Amino Acid FASTA
INFO:nmdc_automation.import_automation.activity_mapper:Processing Contig Mapping File
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Contig Mapping File
INFO:nmdc_automation.import_automation.activity_mapper:Processing Structural Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Structural Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing Functional Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Functional Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing Annotation KEGG Orthology
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Annotation KEGG Orthology
INFO:nmdc_automation.import_automation.activity_mapper:Processing Annotation Enzyme Commission
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Annotation Enzyme Commission
INFO:nmdc_automation.import_automation.activity_mapper:Processing Clusters of Orthologous Groups (COG) Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Clusters of Orthologous Groups (COG) Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing Pfam Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Pfam Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing TIGRFam Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation TIGRFam Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing SMART Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation SMART Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing SUPERFam Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation SUPERFam Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing CATH FunFams (Functional Families) Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation CATH FunFams (Functional Families) Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing CRT Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation CRT Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing Genemark Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Genemark Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing Prodigal Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Prodigal Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing TRNA Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation TRNA Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing RFAM Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation RFAM Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing KO_EC Annotation GFF
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation KO_EC Annotation GFF
INFO:nmdc_automation.import_automation.activity_mapper:Processing Product Names
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Product Names
INFO:nmdc_automation.import_automation.activity_mapper:Processing Gene Phylogeny tsv
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Gene Phylogeny tsv
INFO:nmdc_automation.import_automation.activity_mapper:Processing Crispr Terms
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Crispr Terms
INFO:nmdc_automation.import_automation.activity_mapper:Processing Annotation Statistics
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Annotation Statistics
INFO:nmdc_automation.import_automation.activity_mapper:Processing Annotation Info File
WARNING:root:Import not enabled for nmdc:MetagenomeAnnotation Annotation Info File
INFO:nmdc_automation.import_automation.activity_mapper:Processing Filtered Sequencing Reads
INFO:nmdc_automation.import_automation.activity_mapper:Processing QC Statistics
INFO:nmdc_automation.import_automation.activity_mapper:Processing Read Filtering Info File
INFO:nmdc_automation.import_automation.activity_mapper:Processing Assembly Contigs
INFO:nmdc_automation.import_automation.activity_mapper:Processing Assembly Scaffolds
INFO:nmdc_automation.import_automation.activity_mapper:Processing Assembly Info File
INFO:nmdc_automation.import_automation.activity_mapper:Processing Assembly Coverage Stats
INFO:nmdc_automation.import_automation.activity_mapper:Processing Assembly AGP
INFO:nmdc_automation.import_automation.activity_mapper:Processing Assembly Coverage BAM
INFO:nmdc_automation.import_automation.activity_mapper:Processing Error Corrected Reads
INFO:nmdc_automation.import_automation.activity_mapper:Processing GOTTCHA2 Report Full
WARNING:root:Import not enabled for nmdc:ReadBasedTaxonomyAnalysis GOTTCHA2 Report Full
INFO:nmdc_automation.import_automation.activity_mapper:Processing GOTTCHA2 Classification Report
WARNING:root:Import not enabled for nmdc:ReadBasedTaxonomyAnalysis GOTTCHA2 Classification Report
INFO:nmdc_automation.import_automation.activity_mapper:Processing GOTTCHA2 Krona Plot
WARNING:root:Import not enabled for nmdc:ReadBasedTaxonomyAnalysis GOTTCHA2 Krona Plot
INFO:nmdc_automation.import_automation.activity_mapper:Processing Centrifuge Taxonomic Classification
WARNING:root:Import not enabled for nmdc:ReadBasedTaxonomyAnalysis Centrifuge Taxonomic Classification
INFO:nmdc_automation.import_automation.activity_mapper:Processing Centrifuge output report file
WARNING:root:Import not enabled for nmdc:ReadBasedTaxonomyAnalysis Centrifuge output report file
INFO:nmdc_automation.import_automation.activity_mapper:Processing Centrifuge Krona Plot
WARNING:root:Import not enabled for nmdc:ReadBasedTaxonomyAnalysis Centrifuge Krona Plot
INFO:nmdc_automation.import_automation.activity_mapper:Processing Kraken2 Classification Report
WARNING:root:Import not enabled for nmdc:ReadBasedTaxonomyAnalysis Kraken2 Classification Report
INFO:nmdc_automation.import_automation.activity_mapper:Processing Kraken2 Taxonomic Classification
WARNING:root:Import not enabled for nmdc:ReadBasedTaxonomyAnalysis Kraken2 Taxonomic Classification
INFO:nmdc_automation.import_automation.activity_mapper:Processing Kraken2 Krona Plot
WARNING:root:Import not enabled for nmdc:ReadBasedTaxonomyAnalysis Kraken2 Krona Plot
INFO:__main__:Mapping multiple data files
INFO:nmdc_automation.import_automation.activity_mapper:Processing Metagenome HQMQ Bins Compression File
WARNING:root:Import not enabled for nmdc:MagsAnalysis Metagenome HQMQ Bins Compression File
INFO:__main__:Mapping workflow executions
INFO:root:Processing Reads QC
ERROR:root:Skipping Reads QC due to missing inputs or outputs
ERROR:nmdc_automation.import_automation.activity_mapper:Inputs: ['nmdc:dobj-11-96cke247']
ERROR:nmdc_automation.import_automation.activity_mapper:Outputs: []
INFO:root:Processing Metagenome Assembly
ERROR:root:Skipping Metagenome Assembly due to missing inputs or outputs
ERROR:nmdc_automation.import_automation.activity_mapper:Inputs: []
ERROR:nmdc_automation.import_automation.activity_mapper:Outputs: []
INFO:__main__:Validating imported data
INFO:__main__:Validation Passed
INFO:__main__:Applying update to sequencing data generation
INFO:__main__:Posting data to the API
The text was updated successfully, but these errors were encountered:
I switched from a login node to an interactive now and now import automation is not correctly making the outputs.
Note this can't be rerun as is b/c it will incorrectly push another data object record to has_output for the data_generation_set record.
The text was updated successfully, but these errors were encountered: