Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v8.0] feat (TS): add getTransformationFilesAsJsonString #7840

Merged
merged 4 commits into from
Oct 17, 2024

Conversation

chaen
Copy link
Contributor

@chaen chaen commented Oct 16, 2024

BEGINRELEASENOTES

*Core
FIX: Returning DISET responses with >100000000 bytes

*Transformation
NEW: Use getTransformationFilesAsJsonString for faster getTransformationFiles

ENDRELEASENOTES

@DIRACGridBot DIRACGridBot added the alsoTargeting:integration Cherry pick this PR to integration after merge label Oct 16, 2024
@@ -603,6 +603,7 @@ def getTransformationFiles(
offset=None,
connection=False,
columns=None,
include_web_records=True,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would reverse this flag, and make a tiny WebApp patch.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We suspect it isn't used at all. The idea would be to switch it back in v9 but it's a nasty backwards incompatible change in a patch release if anyone does happen to be using it.

DEncode cannot cope with nested structures of multiple millions items.
Encode everything as a json string, that DEncode cna then transmit faster.

This will be the default as of v9.0
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Then you should add a deprecation notice for export_getTransformationFiles

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We were thinking we would keep getTransformationFiles and deprecate getTransformationFilesAsJson in v9.

@chrisburr chrisburr changed the title feat (TS): add getTransformationFilesAsJsonString [v8r0] feat (TS): add getTransformationFilesAsJsonString Oct 16, 2024
@chrisburr chrisburr changed the title [v8r0] feat (TS): add getTransformationFilesAsJsonString [rel-v8] feat (TS): add getTransformationFilesAsJsonString Oct 16, 2024
@chrisburr chrisburr changed the title [rel-v8] feat (TS): add getTransformationFilesAsJsonString [v8r0] feat (TS): add getTransformationFilesAsJsonString Oct 16, 2024
@chrisburr chrisburr changed the title [v8r0] feat (TS): add getTransformationFilesAsJsonString [v8.0] feat (TS): add getTransformationFilesAsJsonString Oct 16, 2024
@chrisburr chrisburr marked this pull request as ready for review October 17, 2024 08:55
@fstagni fstagni merged commit 5db2e0a into DIRACGrid:rel-v8r0 Oct 17, 2024
26 checks passed
@DIRACGridBot DIRACGridBot added the sweep:done All sweeping actions have been done for this PR label Oct 17, 2024
DIRACGridBot pushed a commit to DIRACGridBot/DIRAC that referenced this pull request Oct 17, 2024
@DIRACGridBot
Copy link

Sweep summary

Sweep ran in https://github.com/DIRACGrid/DIRAC/actions/runs/11384174344

Successful:

  • integration

fstagni pushed a commit to DIRACGridBot/DIRAC that referenced this pull request Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
alsoTargeting:integration Cherry pick this PR to integration after merge sweep:done All sweeping actions have been done for this PR
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants