Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Restore array output in gCNV WDLs for efficient postprocessing. #5490

Merged
merged 2 commits into from
Jan 8, 2019

Conversation

samuelklee
Copy link
Contributor

@samuelklee samuelklee commented Dec 6, 2018

Reverts the reversion in #5225, this time addressing the lexicographical ordering issue in #5217 at the WDL level by simply renaming gCNV output at the command line. If desired, we can eventually change gCNV itself to output filenames that are robust against lexicographic ordering, but this is low priority in my opinion.

@vruano this is what we discussed last week. Tests pass on Travis, and I'm pretty sure this fix should work OK, but I have not done an actual run with enough samples to see the fix in action. Can I assign you to review once I get a chance to do this?

EDIT: Also went ahead and rolled an older PR #5304 into this one so I can test both at the same time.

Closes #4724.

@samuelklee
Copy link
Contributor Author

@asmirnov239 may want to look things over to make sure I haven't screwed anything up, as well!

@codecov-io
Copy link

codecov-io commented Dec 6, 2018

Codecov Report

Merging #5490 into master will decrease coverage by <.001%.
The diff coverage is 85%.

@@               Coverage Diff               @@
##              master     #5490       +/-   ##
===============================================
- Coverage     87.081%   87.081%   -<.001%     
- Complexity     31478     31482        +4     
===============================================
  Files           1929      1930        +1     
  Lines         145041    145052       +11     
  Branches       16074     16074               
===============================================
+ Hits          126303    126312        +9     
  Misses         12891     12891               
- Partials        5847      5849        +2
Impacted Files Coverage Δ Complexity Δ
...ools/copynumber/DetermineGermlineContigPloidy.java 91.304% <100%> (+0.096%) 15 <0> (ø) ⬇️
...hellbender/tools/copynumber/GermlineCNVCaller.java 81.905% <100%> (+0.532%) 10 <0> (ø) ⬇️
...bender/tools/copynumber/utils/CopyNumberUtils.java 57.143% <57.143%> (ø) 2 <2> (?)
...nder/utils/runtime/StreamingProcessController.java 67.299% <0%> (-0.474%) 33% <0%> (ø)
...lotypecaller/readthreading/ReadThreadingGraph.java 88.608% <0%> (-0.253%) 144% <0%> (-1%)
...ithwaterman/SmithWatermanIntelAlignerUnitTest.java 60% <0%> (ø) 2% <0%> (ø) ⬇️
...utils/smithwaterman/SmithWatermanIntelAligner.java 80% <0%> (+30%) 3% <0%> (+2%) ⬆️

@samuelklee
Copy link
Contributor Author

Just a reminder to @vruano, @asmirnov239, and myself that we should probably get this (and any other gCNV WDL improvements) in before 4.1.

@samuelklee
Copy link
Contributor Author

I'll kick off a test run on FC soon (the queue is currently a bit backed up)...

@samuelklee
Copy link
Contributor Author

@vruano @asmirnov239 I think this is good to go, please review.

Copy link
Collaborator

@asmirnov239 asmirnov239 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing it @samuelklee . Looks good to me!

@samuelklee samuelklee merged commit c89c189 into master Jan 8, 2019
@samuelklee samuelklee deleted the sl_postprocess_wdl branch January 8, 2019 20:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants