Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Docs] Added doc on how to handle a large response when using FlyteRemote.sync #1212

Merged
merged 8 commits into from
Oct 7, 2022
Merged

[Docs] Added doc on how to handle a large response when using FlyteRemote.sync #1212

Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
ae44825
Open HashMethod to all types (#1171)
eapolinario Sep 23, 2022
2110598
Return None for SyncCheckpoint.read() when src is empty (#1189)
andrewwdye Sep 24, 2022
2481742
fix: plugins/flytekit-k8s-pod/requirements.txt to reduce vulnerabilit…
snyk-bot Sep 28, 2022
ae5e01f
pyflyte non-fast register (#1205)
pingsutw Sep 29, 2022
55538a7
Update control_plane.rst
Ln11211 Oct 2, 2022
0307336
Merge branch 'flyteorg:master' into master
Ln11211 Oct 4, 2022
9f7505f
Update docs/source/design/control_plane.rst
Ln11211 Oct 6, 2022
976803c
Update control_plane.rst
Ln11211 Oct 6, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 6 additions & 0 deletions docs/source/design/control_plane.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -299,6 +299,12 @@ You can use :meth:`~flytekit.remote.remote.FlyteRemote.sync` to sync the entity
synced_execution = remote.sync(execution, sync_nodes=True)
node_keys = synced_execution.node_executions.keys()

.. note::

During the sync, you may come across ``Received message larger than max (xxx vs. 4194304)`` error if the message size is too large. In that case, edit the ``flyte-admin-base-config`` config map using the command ``kubectl edit cm flyte-admin-base-config -n flyte`` to increase the ``maxMessageSizeBytes`` value. Refer to the :ref:`flyte: <troubleshoot>` in case you've queries about the command's usage.

- To fix this error, edit the flyte-admin-base-config config map to increase ``maxMessageSizeBytes`` value.

``node_executions`` will fetch all the underlying node executions recursively.

To fetch output of a specific node execution:
Expand Down