Improve database updates

[ajcvickers]

This is a grouping of related issues. Feel free to vote (👍) for this issue to indicate that this is an area that you think we should spend time on, but consider also voting for individual issues for things you consider especially important.

---

This an "epic" issue for the theme of improvements to SaveChanges and other database updates. Specific pieces of work will be tracked by linked issues.

Done in 7.0

• Bulk (i.e. set-based) CUD operations (without loading data into memory) ExecuteUpdate/Delete (AKA bulk update, without loading data into memory) #795
• Perf: improve batching for TPH Perf: improve batching for TPH #3954
• Increase batch size by letting ModificationCommandBatch determine it Remove unnecessary extra batches in SaveChanges #20664
• PERF: Investigate optimized rows affected round-tripping when batching PERF: Investigate optimized rows affected round-tripping when batching #7038
• Map inserts, updates, and deletes (CUD operations) to stored procedures Map inserts, updates, and deletes (CUD operations) to stored procedures #245
• Add optimistic concurrency support to CUD sproc mapping #28435

Backlog

• Use the new batching API from ADO.NET #18990
• Add support for INSERT IGNORE / ON CONFLICT DO NOTHING #16949
• Do not track after SaveChanges() #9118
• Perf: Reuse command batches in update pipeline #11574
• Feature like query tags but when calling SaveChanges #14078
• Update of an non-existing, optional entity ends in DbUpdateConcurrencyException #19508
• Allow opt-out of optimistic concurrency/rows affected check in the model #10443
• Merge/Upsert/AddOrUpdate support #4526
• Change-tracking bulk update/delete operations #24176
• Non-tracking ExecuteInsert #29897
• Update Pipeline: Implement cycle breaking for optional relationships #1699
• Consider taking into account collection order in topological sort when entities with generated keys are inserted #15585
• Add IComparable functionality to ValueComparer to support key ordering #23775
• Make ModificationCommandComparer compare provider values #27761
• Add affected entries to "SavedChanges" callback #26564
• Generate idempotent SQL for SaveChanges when retrying a commit failure #10119
• Stop generated cascade delete statements when the DeleteBehavior is database-side #21521
• Provide an option to automatically bulk delete based for cascade delete #18960
• Take Cascade Delete into account when ordering update commands #34361
• Detect indirect update dependencies #17947
• Provide more context to ExecutionStrategy #30023
• Additional ExecutionStrategy extension point: OnOperationRetrying(Async) #12536
• Provide a RetryingExecutionStrategy that relies on the new DbException.IsTransient #21606
• Transaction commit failure: avoid retry by default? #22904
• Generate idempotent SQL for SaveChanges when retrying a commit failure #10119
• Consider cancelling the command in SaveChanges when an error occurs #30182
• Delegate to System.Data savepoint API when that becomes available #21120
• A testing-only transaction manager which replaces nested transactions with savepoints #26504
• Batching through a table variable may not work for non-default collations  #7172
• Allow more granular configuration of batch size #12443
• Soft Delete #4025
• Support store-generated values that are both written to and also read back from the database in the same command #23196
• Strategy for inserting rows with table-values parameters #2484
• Make ModificationCommandComparer compare provider values #27761
• Stop combining delete and insert pairs into updates #30705
• Don't require instance of table-sharing entities if completely contained #15310
• Support stored procedure mappings that are agnostic of inheritance mapping strategy #28806
• Allow mapping inserts and deletes to stored procedures with TVPs #27975
• Add entity splitting support to CUD sproc mapping #28433
• Add "table" splitting and complex type support to CUD sproc mapping #28434
• Ability to specify more facets for sproc parameters and result columns #28436
• Support configuring parameters with constant values for sproc mapping #28438
• Allow configuring sproc mapping to use parameter names for invocation  #28439
• Allow to disable auto-transactions for stored procedures mapped to CUD operations #28511
• Allow to configure any property as the return in CUD sproc mapping #28571
• Allow to configure a property as non-persisted only for a specific mapping #33676

[Seanxwy]

Hope to solve this "epic" problem soon.It's been waiting for years