Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FEATURE] Centralize all modules using ubuntu container into a single container #5968

Open
maxulysse opened this issue Jul 11, 2024 · 1 comment

Comments

@maxulysse
Copy link
Member

Is your feature request related to a problem? Please describe

All of the following modules:

  • cat/fastq
  • custom/tabulartogseacls
  • custom/tabulartogseagct
  • gunzip
  • igv/js
  • md5sum
  • shasum
  • untar

Use the ubuntu container for docker or singularity but a various mix of different conda tools.

  • conda-forge::coreutils
  • conda-forge::grep (actually one use the bioconda::grep)
  • conda-forge::gzip
  • conda-forge::sed
  • conda-forge::tar

And given the different tools' versions within the various ubuntu tag (20.04, 22.04 and 24.04), and the different versions of conda recipe available, I cannot use a single ubuntu container to replicate a conda env, and must use a mix of 2 or 3 depending on the actual tool one want to use. Which is bad from a pipeline point of view, as I would rather have the single one container, than 3 different versions of the same.

Second issue, the untar modules, either in conda or in docker/singularity cannot process tar.bz2 files due to the lack of conda-forge::lbzip2.

Describe the solution you'd like

So my suggestion is to create a new image, based on this conda recipe:

channels:
  - conda-forge
  - bioconda
  - defaults
dependencies:
  - conda-forge::coreutils=9.5
  - conda-forge::grep=3.11
  - conda-forge::gzip=1.13
  - conda-forge::lbzip2=2.5
  - conda-forge::sed=4.8
  - conda-forge::tar=1.34

Here is the singularity corresponding to it in Seqera containers:
oras://community.wave.seqera.io/library/coreutils_grep_gzip_lbzip2_pruned:e1e4ff8dd129544f
and the docker one:
community.wave.seqera.io/library/coreutils_grep_gzip_lbzip2_pruned:10736d98b4d693d8, which I have for now mirrored on quay.io in quay.io/nf-core/coreutils_grep_gzip_lbzip2_pruned:10736d98b4d693d8.

Describe alternatives you've considered

No response

Additional context

No response

@maxulysse
Copy link
Member Author

which should deal with #5704

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant