From 83e209b933430de63539a939a6499e79370d7b91 Mon Sep 17 00:00:00 2001 From: James Bourbeau Date: Thu, 29 Jul 2021 10:15:37 -0500 Subject: [PATCH] Document automatic `MALLOC_TRIM_THRESHOLD_` environment variable (#5139) --- docs/source/worker.rst | 8 ++++++++ 1 file changed, 8 insertions(+) diff --git a/docs/source/worker.rst b/docs/source/worker.rst index faa392d132a..3b409bcfdcd 100644 --- a/docs/source/worker.rst +++ b/docs/source/worker.rst @@ -358,6 +358,12 @@ performance. .. note:: The variable must be set before starting the ``dask-worker`` process. +.. note:: + If using a :ref:`nanny`, the ``MALLOC_TRIM_THRESHOLD_`` environment variable + will automatically be set to ``65536`` for the worker process which the nanny is + monitoring. You can modify this behavior using the ``distributed.nanny.environ`` + configuration value. + jemalloc ~~~~~~~~ *Linux and MacOS workers* @@ -402,6 +408,8 @@ This of course will be problematic if you have a genuine issue with unmanaged me e.g. memory leaks and/or suffer from heavy fragmentation. +.. _nanny: + Nanny -----