Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VS-402. Add VAT Validation check that aa_change and exon_number are consistentally set. #7850

Merged
merged 1 commit into from
May 26, 2022

Conversation

gbggrant
Copy link
Collaborator

Add VAT Validation check that aa_change and exon_number are consistentally set.

@codecov
Copy link

codecov bot commented May 13, 2022

Codecov Report

❗ No coverage uploaded for pull request base (ah_var_store@6767947). Click here to learn what that means.
The diff coverage is n/a.

❗ Current head 0ad3c70 differs from pull request most recent head 5b1eb60. Consider uploading reports for the commit 5b1eb60 to get more accurate results

@@               Coverage Diff                @@
##             ah_var_store     #7850   +/-   ##
================================================
  Coverage                ?   86.296%           
  Complexity              ?     35197           
================================================
  Files                   ?      2170           
  Lines                   ?    164876           
  Branches                ?     17783           
================================================
  Hits                    ?    142282           
  Misses                  ?     16270           
  Partials                ?      6324           

@gbggrant gbggrant force-pushed the gg_VS-402_ValidateForAAChange branch from fefa78d to 9e65874 Compare May 16, 2022 14:00
@gbggrant gbggrant marked this pull request as ready for review May 16, 2022 14:00
if [[ $NUMVARS = "0" ]]; then
echo "PASS: The VAT table ~{fq_vat_table} has consistency across all aa_change and exon_number values in it." > validation_results.txt
else
echo "FAIL: The VAT table ~{fq_vat_table} has $NUMVARS variants for which aa_change and exon_number are inconsistent." > validation_results.txt
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

should there be an exit 1 here?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, the way the code is written all of the validation tasks just put their output into a results file. The workflow itself does not fail if it fails validation. It might make sense to do so, but I'm following the pattern here that @RoriCremer is using.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Definitely curious to hear what @RoriCremer thinks, personally I like validations that make some obvious noise when things don't check out. 🙂

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agreed---I like obvious failures, but I'd prefer that all the tests run

if [[ $NUMVARS = "8" ]]; then
echo "PASS: The VAT table ~{fq_vat_table} has been spot checked for aa_change and exon_number consistency." > validation_results.txt
else
echo "FAIL: The VAT table ~{fq_vat_table} has failed the spot check for aa_change and exon_number consistency." > validation_results.txt
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

here and 1117

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same situation as described above.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm a bit torn here---I think this should always pass for AoU, but if we have other users, the VAT might not have all of these variants
(I think that's fine for now)

@gbggrant gbggrant force-pushed the gg_VS-402_ValidateForAAChange branch from 83ac402 to 45eb768 Compare May 16, 2022 22:34
}
# Check that cases where (aa_change non-null AND exon_number null) OR (aa_change null AND exon_number non-null)
# are all accounted for / understood.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: Do we want to put anything here about "understood" and all these like edge cases?

@gbggrant gbggrant force-pushed the gg_VS-402_ValidateForAAChange branch from d94afbe to bc1318f Compare May 19, 2022 17:16
…tly set.

Added the spot-check test.
Modified the way that the final report is generated, creating a task that generates the report from all of the validation results.
@gbggrant gbggrant force-pushed the gg_VS-402_ValidateForAAChange branch from 0ad3c70 to 5b1eb60 Compare May 19, 2022 17:24
@gbggrant
Copy link
Collaborator Author

@mcovarr @RoriCremer I have modified this now to fail outright if one of the validations fail. It now calls a GenerateFinalReport task as its last task and that will summarize the results in a way that (hopefully) makes it easier to understand the validation failure.

Copy link
Collaborator

@mcovarr mcovarr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thank you for taking this on!

@gbggrant gbggrant merged commit 6d6cb98 into ah_var_store May 26, 2022
@gbggrant gbggrant deleted the gg_VS-402_ValidateForAAChange branch May 26, 2022 15:16
This was referenced Mar 17, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants