Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tracking issue for non-transactional DMLs #33485

Closed
ekexium opened this issue Mar 28, 2022 · 0 comments
Closed

Tracking issue for non-transactional DMLs #33485

ekexium opened this issue Mar 28, 2022 · 0 comments
Assignees
@ekexium
Labels
type/enhancement The issue or PR belongs to an enhancement.

Comments

@ekexium
Copy link
Contributor

ekexium commented Mar 28, 2022 •
edited
Loading

Enhancement

Users need to do a bulk delete or update using a single statement, while currently TiDB cannot satisfy the requirement because of the performance issue, transaction size limit, and compatibility issues with tools.

A new syntax is proposed to work around the problem. A non-transactional DML contains a DML and information that are used to "split" the statement, thus it is equivalent to a sequence of DMLs which is not transactional since it does not provide atomicity and probably isolation.

Different from the deprecated batch-DML, a non-transactional DML splits SQLs so every split SQL is a normal statement and does not risk data-index consistency.
@ekexium ekexium added the type/enhancement The issue or PR belongs to an enhancement. label Mar 28, 2022
@ekexium ekexium mentioned this issue Mar 28, 2022
Merged
12 tasks
@ekexium ekexium self-assigned this Mar 28, 2022
@ekexium ekexium mentioned this issue Apr 6, 2022
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue Apr 15, 2022
@ekexium
*: implement non-transactional delete (#33736)
645ae1c 
ref #33485
@ekexium ekexium mentioned this issue Apr 17, 2022
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue Apr 18, 2022
@ekexium
session: optimize the sharding algorithm for non-transactional DMLs (#…
e10ad28 
…34050)

ref #33485
This was referenced Apr 19, 2022
Merged
Merged
ti-chi-bot pushed a commit that referenced this issue Apr 20, 2022
@ekexium
seesion: skip invisible index when selecting shard column for non-tra…
281aa9c 
…nsactional DML (#34102)

ref #33485
ti-chi-bot pushed a commit that referenced this issue Apr 25, 2022
@ekexium
session: add some compatibility checks for non-transactional DML (#34127
65f329e 
)

ref #33485
espresso98 pushed a commit to espresso98/tidb that referenced this issue Apr 25, 2022
@ekexium @espresso98
session: add some compatibility checks for non-transactional DML (pin…
bbceabf 
…gcap#34127)

ref pingcap#33485
@ekexium ekexium mentioned this issue Apr 27, 2022
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue May 9, 2022
@ekexium
session: refine non-transactional delete (#34273)
6c30303 
ref #33485
This was referenced May 9, 2022
Merged
Merged
ti-chi-bot pushed a commit that referenced this issue May 10, 2022
@ekexium
session: return an error when a non-transactional DML partially fails (…
45415f4 
…#34488)

ref #33485
@ekexium ekexium mentioned this issue May 11, 2022
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue May 11, 2022
@ekexium
session: use batch as the keyword for non-transactional DML (#34467)
d830900 
ref #33485
ti-chi-bot pushed a commit that referenced this issue May 12, 2022
@ekexium
session: fix the memory tracker oom action for nt-dml (#34557)
4bab1db 
ref #33485
@ekexium ekexium mentioned this issue May 16, 2022
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue May 17, 2022
@ekexium
session: fix the setting of _tidb_rowid in non-transactional dml (#34708
1700ccb 
)

ref #33485
ti-chi-bot pushed a commit that referenced this issue May 18, 2022
@ekexium
docs: propose non-transactional DMLs for bulk delete/update scenarios (…
783d97f 
…#33501)

ref #33485
@ekexium ekexium mentioned this issue May 23, 2022
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue May 23, 2022
@ekexium
test: make unit test for nt-dml takes shorter time in favor of CI (#3…
9d0d459 
…4888)

ref #33485
@ekexium ekexium mentioned this issue Sep 27, 2022
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue Oct 19, 2022
@ekexium
session: refactor non-transactional DML to make it ready for more DML…
e48f357 
… types (#38197)

ref #33485
@you06 you06 mentioned this issue Nov 1, 2022
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue Nov 3, 2022
@you06
session: support non-transactional insert statements (#38799)
d7bd49a 
ref #33485
@ekexium ekexium mentioned this issue Nov 14, 2022
Merged
14 tasks
@ekexium ekexium mentioned this issue Nov 21, 2022
Merged
15 tasks
ti-chi-bot pushed a commit that referenced this issue Nov 24, 2022
@ekexium
txn: support multi-table join in nt-dml (#39139)
84fa999 
ref #33485
@ekexium ekexium mentioned this issue Nov 24, 2022
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue Nov 28, 2022
@ekexium
txn: support non-transactional replace (#39378)
ae0bc84 
ref #33485
@ekexium ekexium mentioned this issue Nov 29, 2022
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue Dec 1, 2022
@ekexium
txn: fix alias related bugs for non-transactional DML (#39459)
a6eba9b 
ref #33485
@ekexium ekexium mentioned this issue Dec 2, 2022
Closed
12 tasks
@SunRunAway SunRunAway mentioned this issue Dec 2, 2022
Merged
15 tasks
@ekexium ekexium closed this as completed May 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@ekexium ekexium

Labels
type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@ekexium