Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Reporting/CSV] Increase xpack.reporting.csv.scroll.duration default #162841

Closed
tsullivan opened this issue Jul 31, 2023 · 3 comments
Closed

[Reporting/CSV] Increase xpack.reporting.csv.scroll.duration default #162841

tsullivan opened this issue Jul 31, 2023 · 3 comments
Assignees
Labels
enhancement New value added to drive a business result Team:SharedUX Team label for AppEx-SharedUX (formerly Global Experience)

Comments

@tsullivan
Copy link
Member

tsullivan commented Jul 31, 2023

xpack.reporting.csv.scroll.duration is a setting that users sometimes need to manually update. The default is 30s, which allows 30 seconds of waiting time in between each page of search results during the capture of CSV export data. With frozen tier storage and cross-cluster search, 30 seconds is sometimes not enough for things to work normally.

Two options to change functionality to drive better user experience with exports:

  1. Increase the xpack.reporting.csv.scroll.duration default to 60s. This would reduce the amount of manual configuration needed to make reporting CSV export to work.
  2. Set an value for search timeout programmatically at report execution time. Make it the value as high as possible before the report job itself times out.

Option number 2 seems most favorable. It will use a timeout value based on the latest time when any more time would trigger the xpack.reporting.queue.timeout limit (which uses data in the reporting queue to detect running jobs that have become unresponsive).

@botelastic botelastic bot added the needs-team Issues missing a team label label Jul 31, 2023
@tsullivan tsullivan added enhancement New value added to drive a business result Team:SharedUX Team label for AppEx-SharedUX (formerly Global Experience) labels Jul 31, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/appex-sharedux (Team:SharedUX)

@tsullivan
Copy link
Member Author

Since the scroll duration is a big weak point, rather than using a config setting, maybe we should just set an internal value for it in the code, and make it as high as possible before the report job itself times out.

@tsullivan tsullivan changed the title [Reporting/CSV] Increase xpack.reporting.csv.scroll.duration default to 60s [Reporting/CSV] Increase xpack.reporting.csv.scroll.duration default Sep 18, 2023
@tsullivan
Copy link
Member Author

This issue has become a duplicate of #131852

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New value added to drive a business result Team:SharedUX Team label for AppEx-SharedUX (formerly Global Experience)
Projects
None yet
Development

No branches or pull requests

2 participants