Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[YSQL] Roadmap for mitigating read restart errors #22917

Open
1 task done
pao214 opened this issue Jun 19, 2024 · 0 comments
Open
1 task done

[YSQL] Roadmap for mitigating read restart errors #22917

pao214 opened this issue Jun 19, 2024 · 0 comments
Assignees
Labels
area/ysql Yugabyte SQL (YSQL) kind/enhancement This is an enhancement of an existing feature kind/improve-ux Issues relating to improving user experience. priority/medium Medium priority issue

Comments

@pao214
Copy link
Contributor

pao214 commented Jun 19, 2024

Jira Link: DB-11831

Description

Observability/Debuggability

  1. [YSQL] Supplement "Restart read" error with more information #24431

Testing

  1. [YSQL] Simulate clockbound daemon. #23475
  2. [YSQL] Benchmark the latency impact of calling clockbound lib. #24401
  3. [YSQL] Create a regression test suite for consistent read time. #23405

Deferred Mode

  1. [YSQL] Support deferred mode for writes #24940
  2. [YSQL] Use the deferred mode for COPY #23056
  3. [YSQL] Add an option to defer long reads in high precision clock scenarios #21725

DDLs

  1. [YSQL] Retry DDL transactions internally since DDLs now provide atomicity #24850
  2. [YSQL] Investigate the cause of read restart errors for transactions that only touch catalog tables. #24851

Leverage Time Sync Service

  1. [YSQL] Leverage AWS Clock Bound to reduce the number of read restarts. #21963
  2. [YSQL] Detect violation of clock error bounds as determined by the NTP clock. #22538
  3. [YSQL] Support rolling restart for NTP Clock #22539
  4. [YSQL] Add yb-sample-apps workload(s) to benchmark restart read requests metric. #22537
  5. [YSQL] Add a unit test to detect the causal reverse anomaly #22541
  6. [YSQL] Provide a spanner-like behavior to wait out the clock skew at commit time. #22317

Global Limit Changes

  1. [YSQL] Provide user with option to avoid kReadRestart error with extra cost even if statement's output exceeds ysql_output_buffer_size #20336
  2. [YSQL] Prevent restart read time from exceeding global limit. #24017
  3. [YSQL] Pick global limit as soon as the query arrives at the YSQL backend process. #21961

Local Limit Changes

  1. [YSQL] Investigate why the first request picks a local limit only when the read time is not set. #22158
  2. [YSQL] New test suite for testing local limit #22819
  3. [YSQL] Set local limit in a multi page read #22821
  4. [YSQL] Consider safe time when computing read restart time #23076
  5. [YSQL] Investigate whether we can fetch local limits of multiple tablets on the node #23077

Issue Type

kind/improve-ux

Warning: Please confirm that this issue does not contain any sensitive information

  • I confirm this issue does not contain any sensitive information.
@pao214 pao214 added area/ysql Yugabyte SQL (YSQL) status/awaiting-triage Issue awaiting triage labels Jun 19, 2024
@yugabyte-ci yugabyte-ci added kind/improve-ux Issues relating to improving user experience. priority/medium Medium priority issue labels Jun 19, 2024
@pao214 pao214 self-assigned this Jun 19, 2024
@pao214 pao214 moved this to In Review in Wait-Queue Based Locking Jun 19, 2024
@yugabyte-ci yugabyte-ci added the kind/enhancement This is an enhancement of an existing feature label Jun 19, 2024
@sushantrmishra sushantrmishra removed the status/awaiting-triage Issue awaiting triage label Aug 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/ysql Yugabyte SQL (YSQL) kind/enhancement This is an enhancement of an existing feature kind/improve-ux Issues relating to improving user experience. priority/medium Medium priority issue
Projects
Status: In Review
Development

No branches or pull requests

3 participants