Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix: update channel priorities and snakemake wrappers #562

Merged
merged 25 commits into from
Oct 12, 2022
Merged
Show file tree
Hide file tree
Changes from 22 commits
Commits
Show all changes
25 commits
Select commit Hold shift + click to select a range
fa98dab
change channel priorities in all environments
alethomas Sep 1, 2022
9e237de
fix
alethomas Sep 1, 2022
fd88949
change python version
alethomas Sep 1, 2022
9b139d4
fix typo
alethomas Sep 1, 2022
b3e0ecf
remove stage in
alethomas Sep 1, 2022
51130a1
revert python version pinning
alethomas Sep 1, 2022
4b817aa
updated versions of wrappers in rules
lenakinzel Sep 9, 2022
e536aae
removed dependency of entrez-direct from entrez.yaml as a test becaus…
lenakinzel Sep 9, 2022
ff1f184
fix entrez env
johanneskoester Oct 11, 2022
03e2baf
Update bcftools concat wrapper
johanneskoester Oct 11, 2022
714e672
update bcftools concat wrapper
johanneskoester Oct 11, 2022
1912a0a
bump to latest entrez
johanneskoester Oct 11, 2022
d4244cd
fix output file names for bwa index wrappers
johanneskoester Oct 11, 2022
3926a52
adapt sort argument of bwa mem wrapper to latest version
johanneskoester Oct 11, 2022
8f94494
adapt mark duplicates to wrapper changes
johanneskoester Oct 11, 2022
6e63980
bump pangolin
johanneskoester Oct 11, 2022
89ae9ba
requre older tabulate version
johanneskoester Oct 11, 2022
0919bfc
fmt
johanneskoester Oct 11, 2022
801006b
try bumping notebook version
johanneskoester Oct 11, 2022
c1d8768
fix: notebook versions
johanneskoester Oct 11, 2022
dd22df0
fix wrapper name
johanneskoester Oct 12, 2022
6ef3f50
bump bcftools concat wrapper
johanneskoester Oct 12, 2022
c1ba172
updated and checked all wrappers
johanneskoester Oct 12, 2022
1f6ed46
cleanup
johanneskoester Oct 12, 2022
5c66309
fix extra args
johanneskoester Oct 12, 2022
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 0 additions & 1 deletion .github/workflows/main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -133,7 +133,6 @@ jobs:
- name: Test rule ${{ matrix.rule }} on ${{ matrix.technology }} ${{ matrix.seq_method }} data
uses: snakemake/[email protected]
with:
stagein: mamba env create -f workflow/envs/trinity.yaml -n trinity
directory: .tests
snakefile: workflow/Snakefile
args: "-pr --use-conda --show-failed-logs --cores 2 --resources ncbi_api_requests=1 --conda-cleanup-pkgs cache --conda-frontend mamba ${{ matrix.rule }}"
Expand Down
3 changes: 2 additions & 1 deletion workflow/envs/abyss.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- abyss =2.3.1
3 changes: 2 additions & 1 deletion workflow/envs/bamclipper.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- bamclipper =1.0
- samtools =1.14 # see https://github.com/merenlab/anvio/issues/1479
3 changes: 2 additions & 1 deletion workflow/envs/bcftools.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- bcftools =1.10
3 changes: 2 additions & 1 deletion workflow/envs/bedtools.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- bedtools =2.30.0
3 changes: 2 additions & 1 deletion workflow/envs/canu.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
# do not use canu 2.2 !
- canu =2.1.1
Expand Down
3 changes: 2 additions & 1 deletion workflow/envs/delly.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- delly =0.8.7
- pysam =0.16
5 changes: 3 additions & 2 deletions workflow/envs/entrez.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- entrez-direct =13.9
- entrez-direct =16.2
3 changes: 2 additions & 1 deletion workflow/envs/fgbio.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- fgbio =1.3
3 changes: 2 additions & 1 deletion workflow/envs/genometools.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- genometools-genometools =1.6.2
3 changes: 2 additions & 1 deletion workflow/envs/gff3sort.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- gff3sort = 0.1
3 changes: 2 additions & 1 deletion workflow/envs/kraken.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- kraken2 =2.1.1
- krona =2.7.1
2 changes: 2 additions & 0 deletions workflow/envs/longshot.yaml
Original file line number Diff line number Diff line change
@@ -1,4 +1,6 @@
channels:
- conda-forge
- bioconda
- nodefaults
dependencies:
- longshot =0.4
3 changes: 2 additions & 1 deletion workflow/envs/mason.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- mason =2.0
3 changes: 2 additions & 1 deletion workflow/envs/medaka.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- medaka =1.0
- tensorflow =1.14
Expand Down
3 changes: 2 additions & 1 deletion workflow/envs/megahit.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- megahit =1.2
3 changes: 2 additions & 1 deletion workflow/envs/minimap2.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- minimap2 =2.22
3 changes: 2 additions & 1 deletion workflow/envs/multiqc.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- multiqc =1.11
3 changes: 2 additions & 1 deletion workflow/envs/nanofilt.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- nanofilt =2.8
- gzip =1.11
Expand Down
2 changes: 2 additions & 0 deletions workflow/envs/nanoqc.yaml
Original file line number Diff line number Diff line change
@@ -1,4 +1,6 @@
channels:
- conda-forge
- bioconda
- nodefaults
dependencies:
- nanoqc =0.9
3 changes: 2 additions & 1 deletion workflow/envs/notramp.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,8 @@
channels:
- simakro
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- notramp =1.0.5
- minimap2 =2.22
4 changes: 3 additions & 1 deletion workflow/envs/pangolin.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,7 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- pangolin =4.1.2
- tabulate <0.9 # TODO remove once pangolin 4.1.3 is available in bioconda
1 change: 1 addition & 0 deletions workflow/envs/pysam.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
channels:
- conda-forge
- bioconda
- nodefaults
dependencies:
- jupyter =1.0
- pysam =0.16
Expand Down
1 change: 1 addition & 0 deletions workflow/envs/python.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,7 @@ channels:
- conda-forge
- bioconda
- anaconda
- nodefaults
dependencies:
- pandas =1.2
- jupyter =1.0
Expand Down
3 changes: 2 additions & 1 deletion workflow/envs/quast.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- quast =5.0
3 changes: 2 additions & 1 deletion workflow/envs/ragoo.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
channels:
- bioconda
- conda-forge
- bioconda
- imperial-college-research-computing
- nodefaults
dependencies:
- ragoo =1.1
3 changes: 2 additions & 1 deletion workflow/envs/rbt.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- rust-bio-tools =0.39
3 changes: 2 additions & 1 deletion workflow/envs/samtools.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- samtools =1.14
3 changes: 2 additions & 1 deletion workflow/envs/seqtk.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- seqtk =1.3
3 changes: 2 additions & 1 deletion workflow/envs/snakemake.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- snakemake =7.0
3 changes: 2 additions & 1 deletion workflow/envs/sourmash.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- sourmash =3.5
3 changes: 2 additions & 1 deletion workflow/envs/spades.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- spades =3.15
1 change: 1 addition & 0 deletions workflow/envs/svn.yaml
Original file line number Diff line number Diff line change
@@ -1,4 +1,5 @@
channels:
- anaconda
- nodefaults
dependencies:
- svn =1.10
3 changes: 2 additions & 1 deletion workflow/envs/tabix.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- tabix =0.2
- curl
4 changes: 2 additions & 2 deletions workflow/envs/trinity.yaml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
channels:
- bioconda
- conda-forge
- defaults
- bioconda
- nodefaults
dependencies:
- trinity =2.13
# ensure that we use a bowtie2 that already contains fixed dependency constraints
Expand Down
3 changes: 2 additions & 1 deletion workflow/envs/ucsc.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- ucsc-bigbedtobed =377
3 changes: 2 additions & 1 deletion workflow/envs/unix.yaml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- curl
- sed
3 changes: 2 additions & 1 deletion workflow/envs/varlociraptor.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- varlociraptor =4.9
3 changes: 2 additions & 1 deletion workflow/envs/velvet.yaml
Original file line number Diff line number Diff line change
@@ -1,5 +1,6 @@
channels:
- bioconda
- conda-forge
- bioconda
- nodefaults
dependencies:
- velvet =1.2
2 changes: 1 addition & 1 deletion workflow/notebooks/assembly-benchmark-results.py.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -197,5 +197,5 @@
}
},
"nbformat": 4,
"nbformat_minor": 4
"nbformat_minor": 5
}
2 changes: 1 addition & 1 deletion workflow/notebooks/call-strains.py.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -74,5 +74,5 @@
}
},
"nbformat": 4,
"nbformat_minor": 4
"nbformat_minor": 5
}
2 changes: 1 addition & 1 deletion workflow/notebooks/plot-all-strains-kallisto.py.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -53,5 +53,5 @@
}
},
"nbformat": 4,
"nbformat_minor": 4
"nbformat_minor": 5
}
2 changes: 1 addition & 1 deletion workflow/notebooks/plot-all-strains-pangolin.py.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -46,5 +46,5 @@
}
},
"nbformat": 4,
"nbformat_minor": 4
"nbformat_minor": 5
}
2 changes: 1 addition & 1 deletion workflow/notebooks/plot-read-call.py.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -100,5 +100,5 @@
}
},
"nbformat": 4,
"nbformat_minor": 4
"nbformat_minor": 5
}
2 changes: 1 addition & 1 deletion workflow/notebooks/plot-strains-kallisto.py.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -60,5 +60,5 @@
}
},
"nbformat": 4,
"nbformat_minor": 4
"nbformat_minor": 5
}
2 changes: 1 addition & 1 deletion workflow/notebooks/test-benchmark-results.py.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -52,5 +52,5 @@
}
},
"nbformat": 4,
"nbformat_minor": 4
"nbformat_minor": 5
}
9 changes: 9 additions & 0 deletions workflow/rules/lineage_variant_calling.smk
Original file line number Diff line number Diff line change
Expand Up @@ -48,6 +48,15 @@ rule generate_lineage_variant_table:
"../scripts/generate-lineage-variant-table.py"


rule get_lineage_variant_table:
input:
expand(
"results/{date}/lineage-variant-report/{sample}.csv",
date="2022-05-16",
sample=get_samples_for_date("2022-05-16"),
),


use rule overview_table_html as generate_lineage_variant_report with:
input:
"results/{date}/lineage-variant-report/{sample}.csv",
Expand Down
Loading