Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

backupccl,kv: incorrect historical reads on RESTOREd tables #53044

Closed
dt opened this issue Aug 19, 2020 · 5 comments
Closed

backupccl,kv: incorrect historical reads on RESTOREd tables #53044

dt opened this issue Aug 19, 2020 · 5 comments
Labels
A-disaster-recovery C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. docs-done docs-known-limitation T-disaster-recovery

Comments

@dt
Copy link
Member

dt commented Aug 19, 2020

Historical reads to before the SST was applied may be meaningless after SST application. For example, if RESTORE is used to RESTORE a table to 10:57, it is incorrect to allow a read (or backup) of that table to 10:56, or for a revision_history backup of that table at 10:59 to claim a revision_start_time of < 10:57.

I'm not quite sure what the fallout would be to forward gcthreshold to now on every ingest would be, since you could RESTORE a table to 1057 but that ingest might take an hour. Maybe the AddSST request should optionally carry the revision time to forward to?

Epic CRDB-8816

@dt dt added C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. A-disaster-recovery labels Aug 19, 2020
@dt dt closed this as completed Oct 4, 2021
@dt
Copy link
Member Author

dt commented Oct 4, 2021

this is an understood a limitation, and we'll be solidifying around RESTORE'd data appearing to have been written at the restoration time

@jseldess
Copy link
Contributor

jseldess commented Nov 2, 2021

@dt, does your comment above mean that we should remove this known limitation? https://www.cockroachlabs.com/docs/v21.2/known-limitations.html#historical-reads-on-restored-objects

@dt
Copy link
Member Author

dt commented Nov 2, 2021

Yeah, I suppose depending on how you define the term it isn't really a "known limitation" but just that's how RESTORE works. if you read as of before you restored the table, there's no table, so can't read anything -- is that a known limitation or just how it is? I dunno.

@jseldess
Copy link
Contributor

@livlobo, can you chime in on whether we should remove this as a known limitation? https://www.cockroachlabs.com/docs/dev/known-limitations.html#historical-reads-on-restored-objects

@livlobo
Copy link
Contributor

livlobo commented Nov 13, 2021

I agree with @dt . We can just describe it in the "restore" behavior rather than call it out as a "limitation".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
A-disaster-recovery C-bug Code not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior. docs-done docs-known-limitation T-disaster-recovery
Projects
No open projects
Archived in project
Development

No branches or pull requests

5 participants