Stop running out of diskspace.

[bloodearnest]

This is a meta issue to track various ways we might avoid hitting the disk limits of docker, by either reducing files and sizes, or increasing limits.

Some of these are not job-runner specific, but it seemed like job-runner is as good as any central place to track.

Move to using ubuntu: opensafely-core/backend-server#46

• Technically, this does reduce disk space, but increases the limit. But there are many other reasons.

Implement inputs: proposal: #319

This reduces the number of files copied into the volume.

More efficient copying

• Looping over files and docker cp is not fast, and its error prone: Improve performance of copying large numbers of files in/out of Docker volumes #169

Document, test, and actively encourage use of csv.gz, feather and dta.gz formats

• Our biggest files are dta files, it's worth verifying that these things work with the gzuse package and helping study authors move to them. This may involve manually gzipping some stuff on the server to avoid re-running.

Likewise evangelising and helping folks move to .gz formats wherever possible.

Implement archiving workspaces:

• Implement inactive workspace archival #347

[bloodearnest]

Closing this meta issue, as all but one is done