Skip to content

Commit

Permalink
Merge pull request #80 from genestack/feature/ODM-12031_2-implementat…
Browse files Browse the repository at this point in the history
…ions-plenty-resources

ODM-12031: disclaimer for huge func-file memory limits
  • Loading branch information
m-smazhevsky authored Oct 31, 2024
2 parents a6f0a71 + fc80c6c commit 8f46a48
Showing 1 changed file with 17 additions and 1 deletion.
18 changes: 17 additions & 1 deletion docs/home/release-notes/v1.50-v1.59.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,7 +13,23 @@ If the ODM service is unable to start within the allocated time, increase the `f

### Removal of Application Container Persistent Volume

We have removed the Persistent Volume Claim (PVC) and the necessary configuration for the application's container. This removal is safe, so there's no need for concern.
We have removed the Persistent Volume Claim (PVC) and the necessary configuration for the `applications` container. This removal is safe, so there's no need for concern.

### Increasing memory limits for func-file

A mechanism of attaching files to studies has been extended with new data sources. Attached files are stored in an
S3 bucket, configured for `applications` container. The `func-file` container requires additional memory
to facilitate efficient data transfer. This is particularly critical for the parallel upload of large files
(several gigabytes in size) from the S3 source.

The default configuration works fine for sequential file uploads. To enable parallel uploads,
please increase the `limits` for memory, as well as the `cRTInitialReadBufferSizeInBytes` parameter. Additionally,
it is highly recommended that for JVM services, the values for the `requests` and `limits` parameters be equal.
Take a look at the `odm/examples/parallel-file-upload.yaml` file as an example of configuration,
demonstrating the settings required for the parallel upload of five files, each 10GB in size.
Please contact Genestack support if you need any further help with the configuration.

You can also check Amazon S3 limits here: <https://docs.aws.amazon.com/AmazonS3/latest/userguide/qfacts.html>.

## Version 1.58

Expand Down

0 comments on commit 8f46a48

Please sign in to comment.