Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Optimise installation #3

Open
2 of 4 tasks
chrisburr opened this issue Oct 29, 2020 · 3 comments
Open
2 of 4 tasks

Optimise installation #3

chrisburr opened this issue Oct 29, 2020 · 3 comments
Labels
enhancement New feature or request
Milestone

Comments

@chrisburr
Copy link
Member

chrisburr commented Oct 29, 2020

Currently the installer hasn't been optimised at all however once things are stable it should be adapted to minimise

  • Compressed installer size
  • Installation file count (and hence IO load)
  • Installation time

The following might be helpful for this:

  • Removing unused packages
  • Using .conda packages instead of .tar.bz2
  • Using micromamba instead of conda-standalone
  • Modifying the packages themselves to split into smaller components or to avoid dependencies

Of course it's important that DIRACOS2 is still easy to build and maintain, even if that comes at a small cost.

@chrisburr chrisburr added the enhancement New feature or request label Oct 29, 2020
@chrisburr chrisburr added this to the Later milestone Oct 29, 2020
@chrisburr
Copy link
Member Author

Using .conda as the file format of the packages instead the installer instead of .tar.bz2 (#13) is a big help. The only downside is that building the installer is considerably slower (20 minutes vs 3.5 minutes). Locally this is less of an issue as the output of the "transmuting" process from .tar.bz2 to .conda is cached.

By default with .tar.bz2 packages the installer is 354 MB and takes:

________________________________________________________
Executed in   42.07 secs   fish           external
   usr time   73.87 secs  597.00 micros   73.87 secs
   sys time    7.36 secs   52.00 micros    7.36 secs

With .conda transmuting the installer is 247 MB and takes:

________________________________________________________
Executed in   28.24 secs   fish           external
   usr time   20.97 secs  539.00 micros   20.97 secs
   sys time    8.07 secs   47.00 micros    8.07 secs

@chrisburr
Copy link
Member Author

Installing mysql-client instead of mysql saves another 21MB on the tarball and 75 MB installed.

@chrisburr
Copy link
Member Author

As of DIRACOS v2.16 micromamba is now being used which speeds things up quite a bit (assuming the storage iops can handle it).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant