*: REORGANIZE PARTITION (#38535) #41096
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* mockkv: make pk id = -1 if no primary key column is used (pingcap#38443) * ddl: support modify column on partitioned table (pingcap#38302) close pingcap#38297 * planner: revise isnullRejected check for `And` and `OR` (pingcap#38430) close pingcap#38304 Co-authored-by: xiongjiwei <[email protected]> Co-authored-by: Song Gao <[email protected]>
…| tidb-test=pr/2044 (pingcap#38508) ref pingcap#15000, ref pingcap#38535
* br: add retry for azblob read file (pingcap#39650) close pingcap#39649 * copr: fix data race in the mppIterator (pingcap#39772) close pingcap#39771 * testkit: set GOMAXPROCS in test (pingcap#39766) * statistics: support download history stats from stats_history (pingcap#39701) * *: Support Failed-Login Tracking and Temporary Account Locking (pingcap#39322) close pingcap#38938 * ddl: mark the writes from delete-only and drop them on merge (pingcap#39796) close pingcap#39731 * fix: update ioutil func&pruning case (pingcap#39798) * dumpling: meter network usage (pingcap#39774) close pingcap#39674 * staleread: fix flaky test TestStaleReadProcessorWithExecutePreparedStmt (pingcap#39805) close pingcap#39804 * domain: fix data race in the MockInfoCacheAndLoadInfoSchema (pingcap#39802) close pingcap#39801 * *: upgrade rules_go (pingcap#39797) * *: Add backfill job related tables and operations (pingcap#39616) close pingcap#37122 * ttl: implement ttl job schedule framework (pingcap#39472) close pingcap#39471 * *: stable tiflash test in ddl (pingcap#39825) close pingcap#39831 * planner: fix index prefix matching (pingcap#39377) close pingcap#14581 * parser: add cast to array and member of support (pingcap#39820) close pingcap#39821 * fix: update ioutil.readall (pingcap#39850) * planner: add three fields to statement summary table (pingcap#39828) ref pingcap#39199 * ddl: fix unexpect fail when create expression index (pingcap#39822) close pingcap#39784 * ttl: ouput TTL comment format when show create table (pingcap#39853) close pingcap#39852 * dumpling: add enable paging for tidb server (pingcap#39791) close pingcap#39790 * planner: support explain format='cost_trace' on model ver2 (pingcap#39840) ref pingcap#35240 * ttl, variables: add system variables for ttl job schedule (pingcap#39727) close pingcap#39725 * *: fix slow query nil pointer panic when get session for TTL (pingcap#39865) close pingcap#39864 * ttl: Add metrics for TTL (pingcap#39849) close pingcap#39848 * statistics: support gc outdated historical stats (pingcap#39788) * planner: rename `general plan cache` to `non-prepared plan cache` (pingcap#39873) * planner: rename 'tidb_enable_general_plan_cache' and 'tidb_general_plan_cache_size' to 'tidb_enable_non_prepared_plan_cache' and 'tidb_non_prepared_plan_cache_size' * planner: binding from cluster statements summary (pingcap#39737) ref pingcap#39199 * ttl: modify default value of `tidb_ttl_delete_batch_size` to 100 (pingcap#39878) close pingcap#39877 * ddl: close lightning writers after the import is complete (pingcap#39879) close pingcap#39800 * store/copr: handle region error from client (pingcap#39838) ref pingcap#39361 * ttl: fix scan workers shrink (pingcap#39860) close pingcap#39859 * docs: fix typos (pingcap#39870) * domain: support dump sql meta in plan replayer (pingcap#39863) close pingcap#39883 * SlowLog: Update `Wait_TS` field in slow log for every sql (pingcap#39843) close pingcap#39713 * session: fix a bug for InitDDLJobTables (pingcap#39861) ref pingcap#39854 * ttl: reschedule scan tasks after update task state (pingcap#39891) close pingcap#39890 * ttl: TTL support split scan ranges for some primary key with more than one columns (pingcap#39896) close pingcap#39895 * *: add dependabot (pingcap#39229) * expression: support `json_overlaps` function (pingcap#39867) ref pingcap#39866 * executor, planner: `InitLogger` before `CreateMockStore` in tests to avoid data race (pingcap#39900) close pingcap#39892 * statistics: add source column for stats_meta_hisotry table (pingcap#39835) * ttl: fix ttl txn will not return error when rolling back (pingcap#39918) close pingcap#39917 * expression: close recordset (pingcap#39899) * br: make more sane variables of ticking timeout (pingcap#39887) close pingcap#39620 * expression: support `member of` function (pingcap#39880) ref pingcap#39866 * br: fix err overwrite (pingcap#39935) close pingcap#39934 * ttl: add log in the whole lifecycle of a job (pingcap#39931) close pingcap#39930 * ttl: use optimistic transaction with 0 retry limit for ttl (pingcap#39924) close pingcap#39923 * ttl: periodically update state for a job in heartbeat (pingcap#39939) close pingcap#39938 * parser: support syntax set binding status by sql digest (pingcap#39515) ref pingcap#39199 * *: lock row keys during merging back from temp index (pingcap#39936) close pingcap#39929 * ttl: initialize notifyStateCh in ttl job manager (pingcap#39956) close pingcap#39955 * domain, statistics: periodically update stats healthy distribution (pingcap#39739) close pingcap#39349 * ttl: enable 1pc for ttl delete (pingcap#39958) close pingcap#39957 * docs/design: format the name of 'Adding-Index-Acceleration' RFC. (pingcap#39952) * *: fix auto analyze worker crash when killed by global memory limit (pingcap#39946) close pingcap#39947 * doc: add a proposal for foreign key (pingcap#35982) * domain: Support plan replayer continus capture (pingcap#39926) * expression, json: fix cast json as string with shorter length (pingcap#39970) close pingcap#39963 * sessionctx, executor: fix failure of reading MaxPreparedStmtCount (pingcap#39736) close pingcap#39735 * resourcemanger: create cpu monitor (pingcap#39962) ref pingcap#39657 * *: prevent cursor read from being cancelled by GC (pingcap#39950) close pingcap#39447 * dumpling: supports foreign key limitations (pingcap#39914) close pingcap#39913 * build(deps): bump golang.org/x/net from 0.2.0 to 0.4.0 (pingcap#39996) * planner: fix pessimistic-auto-commit not working for point plans (pingcap#39993) close pingcap#39928 * fix: ebs volume restore failure since incorrect unfinished volumes (pingcap#39975) close pingcap#39974 * planner, json: restore cast flag after substitute column in cast (pingcap#39997) close pingcap#39806 * staleread, session: internal write request should be accepted with external ts (pingcap#39967) close pingcap#39966 * *: revert 38302, forbid modify column on partition table (pingcap#39991) ref pingcap#39915, ref pingcap#39922 * executor: close recordset again (pingcap#40010) * ddl: retry prepare RPC when meets region error (pingcap#39834) close pingcap#39836 * metrics: add EMA cpu usage (pingcap#39995) close pingcap#40029 * executor: fix unstable TestMaxPreparedStmtCount (pingcap#40024) ref pingcap#39735 * *: support sample for compressed files for adjustment (pingcap#39680) ref pingcap#38514 * docs: fix 'enable_global_index' to 'enable-global-index' (pingcap#40009) * expression: introduce `cast(... as ... array)` in expression index (pingcap#39992) close pingcap#40045 * planner: fix the issue that NonPrep Cache cannot work with Explain well (pingcap#40044) close pingcap#40039 * ddl: fix waiting for wrong schema version if TiDB server restart (pingcap#39985) close pingcap#39981 * *: Fix issue 39999, used wrong column id list for checking partitions (pingcap#40003) close pingcap#39999 * oomtest: add whitelist for oom test to fix flaky test (pingcap#40055) close pingcap#40054 * *: extend skyline pruning diagnostic info and add extra warnings (pingcap#39894) ref pingcap#39893 * ddl: add privilege check when alter table add foreign key (pingcap#40051) close pingcap#40050 * planner: add more test cases for non-prep plan cache (pingcap#40060) * sessionctx: disable gc aware memory track (pingcap#40019) close pingcap#39971 * *: make auto-analyze killable by global memory limit (pingcap#39978) ref pingcap#39971, close pingcap#39994 * cpu: fix ticker to avoid close early (pingcap#40036) ref pingcap#40029 * build(deps): bump golang.org/x/time from 0.2.0 to 0.3.0 (pingcap#39912) * ddl: use latest ts to read record for adding index (pingcap#40081) close pingcap#40074 * executor: close recordset again (pingcap#40073) * planner: add more test cases for MPP hints (pingcap#39933) * planner: support set binding status by sql digest (pingcap#39517) ref pingcap#39199 * ddl: check the limitation when creating multi-valued index (pingcap#39818) close pingcap#40086 * sysvar: allow modifying 'tidb_allow_remove_auto_inc' when SEM is ON (pingcap#40083) close pingcap#38238 * *: fix issue of multi-schema change with foreign key (pingcap#40042) close pingcap#40037 * planner: check the `ignore-plan-cache` hint in insert-stmt (pingcap#40080) ref pingcap#39717, close pingcap#40079 * parser: support keep_order and no_keep_order hint (pingcap#39965) ref pingcap#39964 * *: filter particularly errors when `truncateAsWarning` is true (pingcap#40078) * metrics: add metrics for ema cpu metrics and GOGC (pingcap#40049) close pingcap#40092 * server: avoid reusing cached stmt ctx on cursor read (pingcap#40023) close pingcap#39998 * *: optimize mpp probe (pingcap#39932) close pingcap#39686 * statistics: fix the sync load sql did'nt running internally (pingcap#40087) close pingcap#39511 * server: support download plan replayer continues capture file (pingcap#40085) * *: support foreign key check/cascade when execute replace into statement (pingcap#40069) close pingcap#40068 * ddl: fix issue of add foreign key too slow in big table (pingcap#40112) close pingcap#40111 * ddl: fix issue of partition table with foreign key and add more test case (pingcap#40122) * parser: fix cast function restore (pingcap#40129) close pingcap#40130 * ddl: set context correctly in the setDDLLabelForDiagnosis (pingcap#40090) close pingcap#40099 * planner: move code of generating IndexMergePath to a separated file (pingcap#40134) * statistics: fix incorrect datetime value when loading stats (pingcap#40084) close pingcap#39336 * ttl: escape parameters for finish job sql (pingcap#40118) close pingcap#40115 * ddl: prohibit change name of partitioning column (pingcap#40147) close pingcap#40135 * lightning: disable foreign key checks (pingcap#40032) close pingcap#40027 * br: recursive split batch create table when restore failure on batch create table (pingcap#39829) close pingcap#39029 * store/copr: don't reset concurrency of analyze req to 2 (pingcap#40168) close pingcap#40162 * build(deps): bump golang.org/x/oauth2 from 0.2.0 to 0.3.0 (pingcap#40140) * domain: revise plan replayer process log (pingcap#40126) * expression: impl cast as array function (pingcap#40076) close pingcap#40128 * session: fix tidb_enable_gc_aware_memory_track after upgrade (pingcap#40173) ref pingcap#39971, close pingcap#40174 * restore: Fix prealloc (pingcap#40176) close pingcap#40177 * metrics: remove Keep Alive OPM metric (pingcap#40142) close pingcap#40143 * util: fix data race in the cpu test (pingcap#40154) close pingcap#40125 * executor: move some test into writetest (pingcap#40097) * planner: fix an unstable explain test case (pingcap#40199) ref pingcap#35240 * ddl: Refine the error message to compatible with MySQL when drop a partition table partition key column (pingcap#38740) close pingcap#38739 * executor: TiFlash supports stale read (pingcap#40048) close pingcap#40047 * ddl: ignore internal http client goroutine in leak tests (pingcap#40190) close pingcap#40183 * ddl: add more foreign key test case (pingcap#40052) close pingcap#40189 * *: add support for -initialize-sql-file on first bootstrap (pingcap#35625) close pingcap#35624 * *: fix PointGet will return an stale value when `tidb_enable_plan_replayer_capture` is set (pingcap#40197) close pingcap#40194 * planner: support converting `json_member_of` to IndexMerge to access MVIndex (pingcap#40175) ref pingcap#40191 * planner: record reasons when skipping Plan Cache (pingcap#40210) * session: Do not run telemetry loops when it's disabled in config (pingcap#40156) close pingcap#40155 * docs/design: REORGANIZE PARTITION design (pingcap#38246) ref pingcap#15000, ref pingcap#15002 * ddl: Disable RENAME COLUMN for partitioning columns | tidb-test=pr/2054 (pingcap#40151) close pingcap#40150 * dumpling: add foreign key e2e test (pingcap#40133) close pingcap#40227 * ttl: make the TTL compatible with dumpling, lightning and BR (pingcap#40216) close pingcap#40215 * ttl, domain: setup a customized session pool with stats collector (pingcap#40171) close pingcap#40109 * ddl: Support flashback cluster with ddl history (pingcap#40209) ref pingcap#40026 * lightning: add foreign key test (pingcap#40103) close pingcap#40226 * planner: refine planner code for disaggregated tiflash mode (pingcap#39813) close pingcap#39814 * docs: update tidb roadmap based on v6.5 (pingcap#40170) * planner: remove the unnecessary skip-plan-cache flag in StmtCtx (pingcap#40235) * ttl: fix change status sql argument (pingcap#40234) close pingcap#40231 * planner: update the plan cache strategy when expressions with parameters affect null-check (pingcap#40218) close pingcap#38205, close pingcap#40093 * go.mod: upgrade badger to 20221229114011 (pingcap#40236) close pingcap#39237 * executor: write multi-valued index (pingcap#40172) close pingcap#40207 * expression: implement `unhex` function pushdown to tiflash (pingcap#39898) ref pingcap#5112, ref pingcap/tiflash#5112 * planner: remove the unnecessary skip-plan-cache flag in StmtCtx (pingcap#40246) * restore: set config value to default when failed to get config from tikv (pingcap#36051) close pingcap#36053 * ddl: check default value again in updateColumnDefaultValue (pingcap#40230) close pingcap#40164 * docs: update roadmap (pingcap#40244) * *: remove the support of the old ddl framework (pingcap#39684) ref pingcap#39824 * lightning: check peers write stall when switch-mode is disabled (pingcap#40228) close pingcap#40163 * ddl, parser: make generated column and expression index same as MySQL (pingcap#39888) close pingcap#39826 * session: make plan replayer capture support prepared stmt (pingcap#40167) close pingcap#40161 * expression: implement `regexp_replace` function pushdown (pingcap#40267) close pingcap#40266 * planner: supply more test for binding from history (pingcap#40242) ref pingcap#39199 * ttl: disable ttl job when recover/flashback table/database/cluster (pingcap#40268) close pingcap#40265 * admin: impl admin check index for mv index (pingcap#40270) close pingcap#40272 * planner: refactor plan-cache UseCache flag (pingcap#40256) ref pingcap#36598 * test: fix data race in cast as array (pingcap#40277) close pingcap#40276 * planner: support converting `json_overlaps/contains` to IndexMerge to access MVIndex (pingcap#40195) ref pingcap#40191 * autoid_service: add unit test for the package (pingcap#40193) * executor: special handling is required when an "auto id out of range" error occurs in `insert ignore into ... on on duplicate ...` (pingcap#39847) close pingcap#38950 * util: gorotinue pool (pingcap#39872) close pingcap#38039 * metrics: add metrics for plan replayer and historical stats (pingcap#40271) * sysvar: fix circular dependency in rebuildSysVarCache leading to deadlock (pingcap#40283) close pingcap#40240 * ddl: fix flaky test TestGlobalVariablesOnFlashback (pingcap#40291) close pingcap#40287 * server, tidb-server: kill auto analyze when gracefully shutting down (pingcap#40284) close pingcap#40038 * planner: better coordination between the ignore_plan_cache() binding and plan-cache (pingcap#40280) close pingcap#40225 * store/copr: fix build batchCop in disaggregated tiflash mode (pingcap#40008) close pingcap#40035 * ddl: persist index info after changing backfill state (pingcap#40229) close pingcap#40217 * doc: update flashback doc (pingcap#40031) ref pingcap#40026 * ddl, parser: Implement the write-reorg state split task related functions, and the related interfaces of backfill worker (pingcap#39982) close pingcap#37123 * planner: support pushing down predicates to memory tables in prepared mode (pingcap#40262) close pingcap#39605 * planner: open the partial order prop push down for LIST PARTITION (pingcap#40290) close pingcap#40273 * br: fix bootstrap domain (pingcap#40307) close pingcap#40281 * br: add errch buf for checkpoint (pingcap#40166) close pingcap#40165 * planner: skip plan-cache for prepared queries with `INT in (Decimals...)` (pingcap#40312) close pingcap#40224 * statistics: support historical stats dump partition table (pingcap#40310) * *: update badger (pingcap#40331) * expression: enlarge timeout for test (pingcap#40332) * resourcemanger: add cpu scheduler (pingcap#39886) close pingcap#39657 * util: use go-deadlock to find deadlock (pingcap#40288) close pingcap#40293 * *: support `curdate()` as column's default value | tidb-test=pr/2057 (pingcap#40326) close pingcap#38356 * ttl: don't schedule ttl job when EnableTTLJob is off (pingcap#40336) close pingcap#40335 * *: add warnings to slow log and slow query table (pingcap#39884) ref pingcap#39893 * planner,infoschema,executor: Add tiflash fine grained shuffle support for hash join and aggregation (pingcap#40121) close pingcap#40123 * ddl: fill in original default for extra writable columns in batch insert (pingcap#40198) close pingcap#40192 * ddltest: update goleak and enable race (pingcap#40357) close pingcap#40358 * planner: let the planner can select IndexMerge on MVIndex without hint (pingcap#40347) ref pingcap#40191 * makefile: enable deadlock in the with-real-tikv (pingcap#40359) close pingcap#40293 * planner: support more types to use IndexMerge to access MVIndex (pingcap#40343) ref pingcap#40191 * log-backup: should set default value `gc.ratio-threshold` after pitr finished (pingcap#40141) close pingcap#40185 * domain: let plan replayer dump support recording stats mem status (pingcap#40334) * docs: add TiDB Forum link and adjust link order (pingcap#39868) * ddl: support online create multi-valued index (pingcap#40304) close pingcap#40337 * ttl: add `ttl_job_interval` attribute and remove `tidb_ttl_job_interval` variable (pingcap#40033) close pingcap#40028 * *: remove the support of the `amending transaction` (pingcap#39714) close pingcap#40381 * executor: reset the related session vars for both INSERT and REPLACE (pingcap#40354) close pingcap#40351 * *: fix static pruning partition table in disaggregated tiflash mode (pingcap#40238) close pingcap#40239 * planner: fix typo (pingcap#40367) * session: fix data race in the LazyTxn.LockKeys (pingcap#40350) close pingcap#40355 * build(deps): bump golang.org/x/crypto from 0.1.0 to 0.5.0 (pingcap#40379) * executor: fix data race at the ShowExec (pingcap#39817) close pingcap#39816, close pingcap#40295 * planner: fix panic during starting tidb-server if creating global binding for partition table (pingcap#40402) * fix Co-authored-by: Ti Chi Robot <[email protected]> * *: Supports create/alter/drop resource group (pingcap#40188) ref pingcap#38825 * session: fix deadlock when init domain failed (pingcap#40409) close pingcap#40408 * executor: support insert ignore/duplicate replace into with unique multi-valued index (pingcap#40369) close pingcap#40207 * br: support reset_tiflash after ebs restoration (pingcap#40124) close pingcap#40208 * ttl: add ttl goroutine exit log (pingcap#40416) close pingcap#40415 * planner, executor: split the range for unsigned pk of partition table when limit is used (pingcap#40313) close pingcap#40309 * planner: add nil check when handling empty charset in `setUnionFlen` (pingcap#40429) close pingcap#40285 * planner: support keep_order and no_keep_order hint (pingcap#40089) ref pingcap#39964 * planner: unify the behavior of prepare/execute limit to mysql (pingcap#40360) ref pingcap#40219 * gpool: register gpool into resource manager (pingcap#40410) ref pingcap#40412 * ttl: Add `CommandClient` to trigger TTL job manually (pingcap#40346) close pingcap#40345 * ttl: make ttl's group in granfana collapse by default (pingcap#40444) * br: reset cloud_admin and root after ebs restoration (pingcap#39986) close pingcap#40418 * ddl: support displaying sub-job reorg type in admin show ddl (pingcap#40387) close pingcap#40386 * planner: support use IndexMerge to access composite MVIndex (pingcap#40426) ref pingcap#40191 * planner: add test cases for keep_order and no_keep_order hints (pingcap#40321) ref pingcap#39964 * statistics: change the upper bound of the out-of-range estimation to modify count | tidb-test=pr/2012 (pingcap#39011) close pingcap#39008 * docs: update CI build badages (pingcap#40324) close pingcap#40325 * planner: update the non-prep cacheable checker (pingcap#40446) close pingcap#40296 * expression, planner: exclude concat_ws from aggresive folding constant (pingcap#38383) close pingcap#36888 * keyspace: introduce keyspace conf and etcd path (pingcap#40269) ref pingcap#40425 * ddl: skip deleting the unmatched index key on merge (pingcap#40465) close pingcap#40464 * Merge pingcap/master and pingcap/feature/reorganize-partition * Updated CODEOWNERS for the feature branch * ci: add document about some task that will be triggered manually (pingcap#40459) * errno, store: fix ErrPDServerTimeout arguments (pingcap#40468) close pingcap#40439 * ttl: fix the TTL job reports error when primary key contains a column with type `ENUM` (pingcap#40457) close pingcap#40456 * planner: support using DNF to construct IndexMerge to access MVIndex (pingcap#40471) * fixup * fixup * fixup * executor: add partition table testcase for historical stats (pingcap#40453) * add partition table testcase * add partition table testcase * fix lint Co-authored-by: Ti Chi Robot <[email protected]> * ttl: forbid creating/altering a table with TTL options when pk contains float/double column (pingcap#40487) * ttl: forbid create/alter a table with TTL options when pk contains float/double column * format * update * update * update Co-authored-by: Ti Chi Robot <[email protected]> * planner: make MVIndex be compatible with the `use/force index` hint (pingcap#40495) * fixup * fixup * fixup * fixup * lightning: fix codecPDClient (pingcap#40496) Signed-off-by: David <[email protected]> Signed-off-by: David <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> Co-authored-by: Weizhen Wang <[email protected]> * ddl: let concurrent truncate on the same table depend on the previous one (pingcap#40501) * done Signed-off-by: wjhuang2016 <[email protected]> * refine test Signed-off-by: wjhuang2016 <[email protected]> Signed-off-by: wjhuang2016 <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> * statistics: fix estimation error when ranges are too many and modify count is large (pingcap#40472) * fix * fmt * bazel update * update test result Co-authored-by: Weizhen Wang <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> * executor: fix issue of KEY_COLUMN_USAGE table return wrong result about foreign key column (pingcap#40491) Signed-off-by: crazycs520 <[email protected]> Signed-off-by: crazycs520 <[email protected]> Co-authored-by: Weizhen Wang <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> * sysvar: add switch for plan replayer capture using historical stats (pingcap#40492) * add switch * fix * fix * fix Co-authored-by: Weizhen Wang <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> * *: upgrade go1.19.5 (pingcap#40483) Signed-off-by: Weizhen Wang <[email protected]> Signed-off-by: Weizhen Wang <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> * br: need init MDL variable when GetDomain (pingcap#40512) Signed-off-by: joccau <[email protected]> Signed-off-by: joccau <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> * ddl: avoid commit conflicts when updating/delete from mysql.tidb_ddl_reorg. (pingcap#38738) * Added test case * ddl fix pingcap#38669. The issue was that mysql.tidb_ddl_reorg table was updated by an inner transaction after the outer transaction started, which then made a commit conflict in the outer transaction, when it deleted the same row. * Fixed typo in comment * Added test case for pingcap#24427 * Disabled tests for CI testing * Revert "Disabled tests for CI testing" This reverts commit 17c28f3. * Revert "Revert "Disabled tests for CI testing"" This reverts commit 65c84d9. * removed test skips * Clean up the tidb_ddl_reorg entry after DDL is completed * Use a cleanup job afterwards instead. * Fixed test * Moved cleanup before asyncNotify * More detailed test failure log * Refined test error message * Injecting timoeut to get stack traces from CI * Updated Debug Dump on timeout * Delete mulitple entries in tidb_ddl_reorg if needed * Linting * Linting * Added CI debug logs * Linting + CI debugs * fixed CI debug * Try to cleanup also if job.State == synced * check for non-error of runErr instead of error... * Use a new session, instead of reusing worker.sess * Also handle case when job == nil * Removed CI debug logs * Misssed change session from w.sess to newly created sess * Improved TestConcurrentDDLSwitch and added CI debug logs * Always cleaning up all orphan mysql.tidb_ddl_reorg entries * linting * Also cleanup if job is nil * Updated TestModifyColumnReorgInfo + CI debug logs * more CI debug * refactored the cleanupDDLReorgHandle code * Added missing cleanup in handleDDLJobQueue * Removed debug panic * Code cleanup * Test updates * Debug cleanup * Cleaned up test after removal of old non-concurrent DDL code merge * Linting * always wrap changes to tidb_ddl_reorg in an own transaction + fixed some typos * Minimum fix * Always update reorg meta, not only on error * Issue is here :) * Fixed newReorgHandler * Wrapped more tidb_ddl_reorg changes into separate transactions * linting * Removed updateDDLReorgStartHandle * cleanups * Made runInTxn a method on *session, instead of normal function * Update test * Final touches * Removed duplicate test * CleanupDDLReorgHandles should only be called from HandleJobDone. * Variable rename * Renamed 'delete' variabel name * Updated test * small revert * Removed timeout debugging code * Simplified the cleanup to only start a new txn and not a new session * Reverted the change of GetDDLInfo Co-authored-by: Ti Chi Robot <[email protected]> * Post merge fix Signed-off-by: David <[email protected]> Signed-off-by: wjhuang2016 <[email protected]> Signed-off-by: crazycs520 <[email protected]> Signed-off-by: Weizhen Wang <[email protected]> Signed-off-by: joccau <[email protected]> Co-authored-by: Jianjun Liao <[email protected]> Co-authored-by: Weizhen Wang <[email protected]> Co-authored-by: Song Gao <[email protected]> Co-authored-by: lastincisor <[email protected]> Co-authored-by: tangenta <[email protected]> Co-authored-by: Bin <[email protected]> Co-authored-by: Obliviate <[email protected]> Co-authored-by: Lynn <[email protected]> Co-authored-by: YangKeao <[email protected]> Co-authored-by: Daniël van Eeden <[email protected]> Co-authored-by: xiongjiwei <[email protected]> Co-authored-by: fzzf678 <[email protected]> Co-authored-by: Hangjie Mo <[email protected]> Co-authored-by: 王超 <[email protected]> Co-authored-by: Chunzhu Li <[email protected]> Co-authored-by: Yuanjia Zhang <[email protected]> Co-authored-by: you06 <[email protected]> Co-authored-by: raymonder jin <[email protected]> Co-authored-by: TonsnakeLin <[email protected]> Co-authored-by: Zhou Kunqin <[email protected]> Co-authored-by: 山岚 <[email protected]> Co-authored-by: Yifan Xu <[email protected]> Co-authored-by: bb7133 <[email protected]> Co-authored-by: Xiaoju Wu <[email protected]> Co-authored-by: crazycs <[email protected]> Co-authored-by: zyguan <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com> Co-authored-by: fengou1 <[email protected]> Co-authored-by: wjHuang <[email protected]> Co-authored-by: mychoxin <[email protected]> Co-authored-by: Chengpeng Yan <[email protected]> Co-authored-by: CbcWestwolf <[email protected]> Co-authored-by: hackersean <[email protected]> Co-authored-by: Yujie Xia <[email protected]> Co-authored-by: jiyfhust <[email protected]> Co-authored-by: hehechen <[email protected]> Co-authored-by: Morgan Tocker <[email protected]> Co-authored-by: Xiaoguang Sun <[email protected]> Co-authored-by: guo-shaoge <[email protected]> Co-authored-by: Ran <[email protected]> Co-authored-by: baishen <[email protected]> Co-authored-by: lance6716 <[email protected]> Co-authored-by: xzhangxian1008 <[email protected]> Co-authored-by: tiancaiamao <[email protected]> Co-authored-by: Jk Xu <[email protected]> Co-authored-by: djshow832 <[email protected]> Co-authored-by: Yiding Cui <[email protected]> Co-authored-by: yibin <[email protected]> Co-authored-by: Zak Zhao <[email protected]> Co-authored-by: luzizhuo <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> Co-authored-by: ShuNing <[email protected]> Co-authored-by: 3pointer <[email protected]> Co-authored-by: wuhuizuo <[email protected]> Co-authored-by: ystaticy <[email protected]> Co-authored-by: David <[email protected]>
…nto reorg-part-merge-jan31
|
[REVIEW NOTIFICATION] This pull request has been approved by:
To complete the pull request process, please ask the reviewers in the list to review by filling The full list of commands accepted by this bot can be found here. Reviewer can indicate their review by submitting an approval review. |
ti-chi-bot
added
release-note
|
/test build |
|
/retest |
|
/test unit-test |
|
/retest |
|
/test build |
|
/retest |
hawkingrei
approved these changes
Feb 9, 2023
ti-chi-bot
added
status/LGT2
|
/merge |
|
This pull request has been accepted and is ready to merge. Commit hash: f081d66
|
ti-chi-bot
added
the
status/can-merge
|
/retest |
|
@mjonss: Your PR was out of date, I have automatically updated it for you. If the CI test fails, you just re-trigger the test that failed and the bot will merge the PR for you after the CI passes. Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the ti-community-infra/tichi repository. |
|
/hold merge queue |
ti-chi-bot
added
the
do-not-merge/hold
12 tasks
…part-master-merge
ti-chi-bot
removed
the
status/can-merge
bb7133
removed
the
do-not-merge/hold
…part-master-merge
12 tasks
…part-master-merge
|
/test unit-test |
|
/merge |
|
This pull request has been accepted and is ready to merge. Commit hash: 6148f3e
|
ti-chi-bot
added
the
status/can-merge
lcwangchao
added a commit
to lcwangchao/tidb
that referenced
this pull request
Feb 13, 2023
* statistics: fix data race in the Handle.IsTableLocked (pingcap#40572) close pingcap#40567 * executor,store/copr: trace the buildCopTask and limitExec close duration when it's slow (pingcap#40579) ref pingcap#40441 * planner: prepared plan cache support cached plan with placeholder in limit clause (pingcap#40196) ref pingcap#40219 * planner: refactor to put all plan-cacheability-check functions together (pingcap#40625) ref pingcap#36598 * testkit: reset the resource manager after test finishes (pingcap#40638) * planner: disable plan-cache for plans with IndexMerge accessing Multi-Valued Index (pingcap#40646) ref pingcap#40191 * test: add more foreign key test (pingcap#40650) close pingcap#40649 * ddl: Block change column on partitioned table if data needs change. (pingcap#40631) close pingcap#40620 * planner: show un-cacheable reasons for execute statements (pingcap#40651) ref pingcap#36598 * ddl: cancel `create view` job , when failed to drop old view (pingcap#40353) close pingcap#40352 * domain: use enhanced waitGroupWrapper in domain pingcap#40606 (pingcap#40626) ref pingcap#40330 * privilege,planner/core: add dynamic privilege RESOURCE_GROUP_ADMIN for resource group operation (pingcap#40632) ref pingcap#38825 * *: add a new I_S table and support show create for resource groups (pingcap#40665) close pingcap#39781 * meta: add lock at autoid.(*allocator).Base() (pingcap#40588) close pingcap#40584 * *: Support learner replica read (pingcap#39979) close pingcap#40449 * Revert "planner: show un-cacheable reasons for execute statements" (pingcap#40680) ref pingcap#36598 * executor: fix buildTableReaderForIndexJoin on partition table (pingcap#40674) close pingcap#40596 * util: remove empty folder (pingcap#40681) * domain: let background process unify wg.Run (pingcap#40640) * BR: add lock with ttl for checkpoint backup (pingcap#40563) close pingcap#40561 * *: LOAD DATA support load one file from s3 and other OSS (pingcap#40489) ref pingcap#40499 * ttl: execute scan tasks (pingcap#40564) close pingcap#40364 * ddl: fix the batch check for unique index (pingcap#40672) ref pingcap#40464, close pingcap#40592 * resourcemanager: avoid to get nil after task finished when to stop task (pingcap#40699) close pingcap#40700 * planner: refactor plan cache value code (pingcap#40656) ref pingcap#40219 * telemetry: resource control telemetry (pingcap#40687) ref pingcap#38825 * planner: set binary collation for mv column (pingcap#40644) close pingcap#40558 * ddl: add some tests for flashback cluster with ddl history (pingcap#40695) ref pingcap#40026 * pitr: move step iterate backup files into worker pool (pingcap#40577) close pingcap#40576 * ddl, lightning: support detecting duplicate keys in different batch (pingcap#40701) close pingcap#40698 * json, expression: add json unary not implementation (pingcap#40723) close pingcap#40683 * ddl: prevent dropping in-use resource group (pingcap#40716) ref pingcap#38825 * store/copr: move row hint into key range (pingcap#40105) ref pingcap#39361 * server, privileges: make tidb_auth_session_token compatible with password expiration and resource group (pingcap#40735) ref pingcap#40614 * mockstore: update pd/client and client-go to repair kvproto compatibility (pingcap#40597) close pingcap#40598 * Explain : Add new item in TiFlashScanContext to record region num information (pingcap#40666) ref pingcap#39273 * *: Setup Global Resource Controller (pingcap#40732) close pingcap#40731 * tests: enable race and flaky for flashback test (pingcap#40752) * br: split regions before pitr restore (pingcap#39941) close pingcap#37207 * log-backup: do not resolve locks frequently when log-backup task did not exist (pingcap#40760) ref pingcap#40759 * lint: update config of deprecated linter (pingcap#40763) ref pingcap#40786 * lightning: check hasDupe and tableID when resolve duplicate rows (pingcap#40696) close pingcap#40657 * planner: skip the plan cache if non-int values are converted into int when optimization (pingcap#40686) close pingcap#40679 * *: Remove unused binary that was accidentally added (pingcap#40782) close pingcap#40781 * linter: add skywalking-eyes into bazel (pingcap#40788) close pingcap#40789 * planner: remove pickFromBucket field in LRUPlanCache (pingcap#40668) ref pingcap#36598 * statistics: move statsReader out of statistics/handle (pingcap#40790) ref pingcap#40624, ref pingcap#40791 * linter: find inappropriate key in call to context.WithValue (pingcap#40769) close pingcap#40796 * ttl: notify tidb nodes through etcd notification (pingcap#40705) close pingcap#40365 * executor: add foreign key and session variable test (pingcap#40785) close pingcap#40784 * ttl: add table `mysql.ttl_job_history` to store ttl job histories (pingcap#40655) close pingcap#40654 * planner: forbid the optimizer to generate point-plan upon MVIndexes (pingcap#40804) ref pingcap#40191 * planner: refactor some code related to IndexMerge and MVIndex (pingcap#40800) ref pingcap#40191 * ddl: remove useless code (pingcap#40756) close pingcap#40755 * ttl: use a standalone manager in TriggerScanTask test (pingcap#40816) close pingcap#40811 * ddl: split some tests into new package (pingcap#40758) ref pingcap#40802 * resourcemanager: scheduler subtask in the pool's task (pingcap#40670) close pingcap#40719 * bazel: upgrade rules_go to prepare for Go 1.20 (pingcap#40776) close pingcap#40798 * store/copr: add a param "limit" to region cache's `SplitRegionRanges` (pingcap#40411) close pingcap#38436 * br: fix checkpoint panic when BR executes gain (pingcap#40706) close pingcap#40704 * sessionctx: add validation for tidb_enable_plan_replayer_continues_capture (pingcap#40787) * planner: show warnings when analyzing multi-valued indexes (pingcap#40827) ref pingcap#40191 * ddl: move update version function to a proper place (pingcap#40817) ref pingcap#40217 * lightning: support timeout for tikv/tidb retry (pingcap#40805) ref pingcap#33714 * ttl: support telemetry for TTL (pingcap#40806) close pingcap#40519 * ttl: auto delete old rows in `mysql.tidb_ttl_job_history` (pingcap#40808) close pingcap#40807 * lightning: support data files with bom header (pingcap#40813) close pingcap#40744 * planner: support `use / force index` for multi-valued indexes (pingcap#40820) ref pingcap#40191 * lightning/parser: support STARTING BY (pingcap#40821) ref pingcap#40499 * planner: add a switch control if prepare stmt with param limit can be cached (pingcap#40712) ref pingcap#40219 * metrics: add goroutine schedule latency to grafana panel (pingcap#40836) close pingcap#40835 * server: support getting the MVCC of the temporary index (pingcap#40830) close pingcap#40826 * planner: let optimizer trace support gcSubstitute (pingcap#40815) close pingcap#40662 * planner: add more test cases for MVIndex (pingcap#40853) ref pingcap#40191 * planner: supply test cases for binding from history (pingcap#40864) ref pingcap#39199 * ddl: unsupport flashback cluster cross `alter table attributes` (pingcap#40862) close pingcap#40861 * bindInfo: fix datarace on bindings (pingcap#40846) close pingcap#40843 * executor: add historical stats test and make it enabled (pingcap#40664) * Variables: enhance tidb_enable_gc_tuner (pingcap#40850) close pingcap#40849 * ttl: add metrics for task manager (pingcap#40819) close pingcap#40810 * lightning: enable setting conflict max-error (pingcap#40874) ref pingcap#40743 * DDL: Skip collecting TiFlash status when TiFlash is down (pingcap#40872) close pingcap#38484 * server: Return error when no password is specified for caching_sha2_password account with password (pingcap#40858) close pingcap#40831 * br: fix br debug encode panic (pingcap#40880) close pingcap#40878 * planner: fix HashAgg cannot pushdown to tiflash_compute (pingcap#40828) close pingcap#40717 * parser: Fix for field name output in multi statements (pingcap#40736) close pingcap#39662 * expression, cmd: fix ColumnSubstitute and allow some cases to substitute (pingcap#38826) close pingcap#38736, close pingcap#40536 * planner: forbid using IndexFullScan on multi-valued indexes (pingcap#40907) ref pingcap#40191 * lightning: local backend support keyspace (pingcap#40628) ref pingcap#40531 * README: refine the Forum infomation format in community section (pingcap#40924) * ttl: don't fetch ttl scan task after it finished (pingcap#40919) close pingcap#40918 * executor: Fix tidb crash on index merge reader (pingcap#40904) close pingcap#40877 * util: add InTest to check whether to be in test (pingcap#40927) close pingcap#40929 * *: upgrade mgechev/revive (pingcap#40920) * ddl: fix create exists resource group (pingcap#40837) ref pingcap#38825 * handle: support fallback for dump historical stats (pingcap#40889) close pingcap#40890 * admin: support cleanup multi-valued index (pingcap#40428) close pingcap#40427 * *: support MockAutoScaler and AWSAutoScaler (pingcap#40729) close pingcap#40747 * session: fix bad log (pingcap#40948) close pingcap#40947 * planner: fix dropping non-ScalarFunction when extractCol for memtable (pingcap#40935) close pingcap#40937 * planner: supply test cases for param limit in plan cache (pingcap#40868) ref pingcap#40219 * br: disable foreign key check when br create table (pingcap#40951) close pingcap#40952 * planner: rename keep_order hint to order_index hint for mysql compatibility (pingcap#40945) * planner: report the warning when use the hint but the SQL has the binding (pingcap#40949) close pingcap#40910 * *: add ci image (pingcap#40866) close pingcap#40867 * metrics: introduce the resource control RU Grafana dashboard (pingcap#40922) ref pingcap#38825 * planner: add MppVersion for mpp task; support data compression in Exchange Operator; (pingcap#40132) ref pingcap/tiflash#6620, close pingcap#40494 * *: unify wru,rru to ru (pingcap#40884) close pingcap#40883 * br: adaption for keyspace feature (pingcap#40532) ref pingcap#40531 * resourcemange: fix delete more workers than expected (pingcap#40894) close pingcap#40893 * keyspace: gc delete range (pingcap#40639) ref pingcap#40848 * ddl: add more tests about multi-valued index (pingcap#40973) * test: stabilize TestAddIndexMergeConflictWithPessimistic (pingcap#40975) close pingcap#40939 * *: add UseAutoScaler config to disable AutoScaler (pingcap#40966) close pingcap#40971 * *: add memory tracker for mppIterator (pingcap#40901) close pingcap#40900 * resource_group: supports burstable for resource group (pingcap#40925) close pingcap#40380 * util: fix memory leak in chunk allocator (pingcap#40989) close pingcap#40987 * ddl, statistics: fix stats meta missing when creating many tables at once (pingcap#38301) close pingcap#36004, close pingcap#38189 * statistics: move TableStatsFromStorage out of handle (pingcap#40822) ref pingcap#40624, ref pingcap#40791 * br: remove totalFlashbackRegions since task completion region already contains all regions (pingcap#40504) close pingcap#40391, ref pingcap#41005 * lightning: fix panic when nextKey twice (pingcap#40959) close pingcap#40934 * ttl: fix data race in TTL manager and test (pingcap#40976) close pingcap#40944 * session: use `mDDLTableVersion` key to control backfill tables (pingcap#40984) close pingcap#40980 * planner: not allow the optimizer to use `json_contains(j, '[]')` as access conditions on MVIndex (pingcap#41013) ref pingcap#40191 * ddl/ingest: add mutex to disk root (pingcap#41029) close pingcap#40970 * ttl: avoid endless loop in TTL task schedule (pingcap#41020) close pingcap#41019 * resourcemanager: fix TaskController.Stop() can't make producer exit in spmcpool (pingcap#41016) close pingcap#41015 * *: add buildtag for ddltest (pingcap#41027) * statistics: use histogram count rather than realtime count to calculate stats healthy (pingcap#41031) * pd_client: update client and global config (pingcap#40955) ref pingcap#38825 * ddl: show more jobs in the tidb_mdl_view (pingcap#40860) close pingcap#40838 * *: add resource group name into information_schema.processlist (pingcap#40739) close pingcap#40724 * *: upgrade golangci-linter (pingcap#41046) * executor: fix IndexMerge handle panic logic (pingcap#41036) close pingcap#41047 * ttl: fix TTL will delete unexpected rows when timezone changed (pingcap#41044) close pingcap#41043 * *: fix the sysvar value may be corrupted after set by subquery (pingcap#41003) close pingcap#40979 * ddl, parser: implement the normal flow of distributed processing in DDL reorg phase for adding index (pingcap#40542) close pingcap#37125 * session, metrics: refine the resource control metrics (pingcap#41045) ref pingcap#38825 * meta: fix remove resource group (pingcap#40968) ref pingcap#38825 * metrics/grafana: add cpu/memory of pd in overview panel (pingcap#41072) close pingcap#41071 * lightning: precheck should check CDC changefeeed rather than capture (pingcap#41076) close pingcap#41040 * ttl: fix ttl job manager will panic if the status cache doesn't contain table (pingcap#41069) close pingcap#41067, close pingcap#41068 * sessionctx: fix hidden and user var problems in encoding session states (pingcap#40754) close pingcap#40614 * Revert "planner: skip the plan cache if non-int values are converted into int when optimization" (pingcap#41077) ref pingcap#41032 * schema cache: cache schema version by timestamp (pingcap#40768) close pingcap#40740 * executor: fix plan replayer dump for tpcds q97 (pingcap#41088) close pingcap#41064 * *: update util/tracing and remove repeated code (pingcap#40825) close pingcap#40809 * telemetry: Log error reason for failure to get SQL Metric (pingcap#40778) close pingcap#40777 * br: add retry for prepare flashback for backup cluster is empty and there are only one region (pingcap#41059) close pingcap#41058 * server: Implement column defaults for `mysql.ComFieldList` (pingcap#40765) close pingcap#40764 * resourcemanager: avoid to schedule when no task is in the pool (pingcap#41095) close pingcap#41094 * *: Update github.com/cloudfoundry/gosigar (pingcap#41111) close pingcap#41110 * ddl: remove useless error log (pingcap#41107) close pingcap#41106 * executor: use const varialbe for index merge handleWorkerPanic (pingcap#41066) close pingcap#41065 * Optimizer: add test cases for predicate simplifications (pingcap#41117) ref pingcap#40221 * executor: disable paging for small limit (pingcap#41120) close pingcap#40741 * flashback: retry `getStoreGlobalMinSafeTS` during execute flashback (pingcap#41100) close pingcap#41086 * metrics: add tidb_rm_pool_concurrency (pingcap#41113) close pingcap#41114 * handler: fix duplicated log of unanalyzed table for historical stats (pingcap#41129) * *: update client-go and pd client (pingcap#41124) close pingcap#41123 * admin: fix recover expression cause index broken (pingcap#41092) ref pingcap#40430, close pingcap#41087 * statistics/handle: remove unnecessary h.mu.Lock (pingcap#41153) * parser: move LOAD DATA REMOTE into LOAD DATA (pingcap#41091) ref pingcap#40499 * planner: support more pattern for index join inner side (pingcap#40999) ref pingcap#40505 * planner: support more pattern for index join inner side (pingcap#40999) ref pingcap#40505 * planner: support more pattern for index join inner side (pingcap#40999) ref pingcap#40505 * makefile: update dumpling build options (pingcap#41165) * statistics/handle: refine the condition of dumping stats delta (pingcap#41133) ref pingcap#36004, ref pingcap#38189, ref pingcap#39785 * *: use the latest independent resource group manager client (pingcap#41162) ref pingcap#38825 * store/copr: set upper limit for extra concurrency (pingcap#41135) close pingcap#41134 * planner: label plans as over-optimized for plan cache after refining cmp-function arguments (pingcap#41136) close pingcap#40679, close pingcap#41032 * planner: when pushing `topN` down below `proj`, check whether `topN.ByItems` contains a column(with ID=0) generated by `proj` (pingcap#40593) close pingcap#40535 * *: update bazel config (pingcap#41127) close pingcap#41160 * br: fix br ci (pingcap#41149) * *: fix a timezone data race which may cause wrong row data (pingcap#41146) close pingcap#40710 * ddl: disable raw mode resource group (pingcap#41050) close pingcap#41049 * flashback: make `br backup full` works during `flashback cluster` (pingcap#40950) close pingcap#40404 * placement: supports survival preferences (pingcap#40613) close pingcap#38605 * log-backup: added more robust error handling for log backup advancer (pingcap#41083) close pingcap#41082 * lightning: access aws resource by session token (pingcap#40753) close pingcap#40750 * lightning: introduce param to skip CSV header parsing (pingcap#41128) close pingcap#40839 * ddl: forbid tiflash while enabling API v2 (pingcap#41167) ref pingcap#41166 * store/copr: enable store batch by default & add extra copr concurrency and batch nums in stats (pingcap#40711) ref pingcap#39361, close pingcap#40399 * *: remove ru token in resource group schema and set brust limit (pingcap#41174) ref pingcap#38825 * ReplicaReadMode: introduce new replica_read mode `PreferLeader`. (pingcap#40906) close pingcap#40905 * txn: Fix the issue that analyze panics when aggressive locking is enabled globally (pingcap#41196) close pingcap#41194 * pitr: prevent from restore point to cluster running log backup (pingcap#40871) ref pingcap#40797 * lightning: do resolve conflict job when other lightning has local dupes (pingcap#41157) close pingcap#40923 * executor: track the memroy usage in HashJoin probe phase (pingcap#41081) close pingcap#40500 * *: support recover multi-valued index (pingcap#41181) close pingcap#41180 * stmtsummary: add persistence implementation (pingcap#40814) ref pingcap#40812 * br: Support backup replica read (pingcap#40899) ref pingcap#40898 * store/copr: add log for buildBatchCopTasksConsistentHash (pingcap#41101) close pingcap#41102 * lightning: support compression when sending kv pairs to tikv (pingcap#41164) close pingcap#41163 * planner: skip plan cache if the plan contains Shuffle operators (pingcap#41185) close pingcap#38335 * expression: implement least/greatest for string function pushdown (pingcap#41188) close pingcap#41189 * go.mod: update client-go to the latest version (pingcap#41212) ref pingcap#38825 * add metrics for TTL (pingcap#41155) Signed-off-by: YangKeao <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> Co-authored-by: 王超 <[email protected]> * metrics: Add metrics and telemetry for aggressive locking (pingcap#41038) close pingcap#41037 * planner: adjust estimated row count when pushing `Limit` and keep order for partitioned table (pingcap#41103) close pingcap#40986 * planner: fix can't find proper physical plan caused by virtual column (pingcap#41132) close pingcap#41014 * planner: fix space requirement when binding from history (pingcap#41140) close pingcap#41126 * ddl: initialize the mock session in advanced (pingcap#41227) close pingcap#40879 * ddl: fix data race on job.SetWarnings (pingcap#41231) close pingcap#40751 * *: remove limit (pingcap#41242) * *: remove limit Signed-off-by: Weizhen Wang <[email protected]> * *: remove limit Signed-off-by: Weizhen Wang <[email protected]> * *: remove limit Signed-off-by: Weizhen Wang <[email protected]> --------- Signed-off-by: Weizhen Wang <[email protected]> * br: skip template system table __TiDB_BR_Temporary_mysql when backup (pingcap#41000) close pingcap#40797 * ddl, model: support for dist-reorg on partitioned tables (pingcap#41145) close pingcap#41144 * session: fix processInfo time when using driver to prepare and execute query (pingcap#41151) close pingcap#41057 * dumpling: fix cannot dump data bug when dumpling fails to check has tikv (pingcap#40977) close pingcap#40932 * lightning: fix panic when user cancel (pingcap#41236) close pingcap#41235 * util/gpool/spmc: add a sleep to a simple `for` (pingcap#41240) close pingcap#41205 * planner: fix calculating TiFlash stream count (pingcap#41221) ref pingcap#40123 * ddl: check the key existence on original index (pingcap#40749) close pingcap#40730 * types: use `mathutil.Max/mathutil.Min` instead of `myMax/myMin` (pingcap#41192) * bazel: set --test_keep_going false (pingcap#41247) * ddl: Add telementry for distributed reorg tasks. (pingcap#41201) ref pingcap#41266 * ddl: Improve ErrTooLongKey message (pingcap#41270) Prefix indexes are specified in characters while this error message returns a limit in bytes. By adding the byte length in the message this is makes it easier to understand. This would deviate a little bit from the message in MySQL. Before: ``` sql> CREATE TABLE t1(id int primary key, c1 text, key(c1(1000))); ERROR: 1071 (42000): Specified key was too long; max key length is 3072 bytes ``` After: ``` sql> CREATE TABLE t1(id int primary key, c1 text, key(c1(1000))); ERROR: 1071 (42000): Specified key was too long (4000 bytes); max key length is 3072 bytes ``` * ddl: fix owner get panic info with dist-reorg (pingcap#41217) close pingcap#41208 * planner: recover table/schema only needs create and drop privilege (pingcap#41226) close pingcap#40633 * Lightning: use **** to represent secret key in unit test (pingcap#41269) close pingcap#41268 * ddl: improve backfill more general (pingcap#41093) close pingcap#41002 * executor: fix unreasonable CPU time in HashJoin probe phash (pingcap#41265) close pingcap#41263 * ttl: optimize bazel for TTL codes (pingcap#41278) close pingcap#41276 * executor: support plan replayer capture remove task (pingcap#41258) close pingcap#41262 * expression: return upper bound for enum (pingcap#41021) close pingcap#40855 * lightning: revert db timeout changes for analyze (pingcap#41012) close pingcap#40941 * *: REORGANIZE PARTITION (pingcap#38535) (pingcap#41096) close pingcap#38535 * br: fix backup ci (pingcap#41295) ref pingcap#40404, ref pingcap#40898 * *: reduce the allocation of error constructing in `DecodeTableID` (pingcap#41301) close pingcap#41300 * util: fix dropped error (pingcap#41254) * metric: seperate the internal and external transaction metrics (pingcap#41206) ref pingcap#41203 * planner: fix a bug when pushing streamAgg down (pingcap#41056) close pingcap#40857 * build(deps): bump golang.org/x/oauth2 from 0.3.0 to 0.5.0 (pingcap#41283) * Optimizer: derive TopN from filter on row number (pingcap#41209) ref pingcap#39792 * domain: fix data race in the ttlJobManager (pingcap#41289) close pingcap#41288 * stmtsummary: fix data race in test (pingcap#41287) close pingcap#41275 * ddl: return panic when to get tiflash sync progress failed in test (pingcap#41292) close pingcap#39949 * infoschema: fix is.partitions.partition_expression for range columns (pingcap#41285) close pingcap#40931 * sysvar: introduce variable tidb_enable_inl_join_inner_multi_pattern (pingcap#41319) ref pingcap#40505 * executore: fix logic error in HashJoin probe (pingcap#41320) * *: update bazel config (pingcap#41296) * infoschema: fix unstable test TestSelectClusterTable (pingcap#41321) close pingcap#41307 * log-backup: added cache for sst_importer client (pingcap#41305) close pingcap#41328 * stmtsummary: fix panic in stmts test (pingcap#41334) close pingcap#41315 * *: fix goleak in the test (pingcap#41339) close pingcap#41274 * planner: fix tiflash cannot find generated column (pingcap#41261) close pingcap#40663 * server, execute: set text for execute command (pingcap#41340) close pingcap#41156 * br: increase the sleep time in the `waitForSend` function (pingcap#41322) close pingcap#41210 * cgroup: improve test to find cgroup compatibility issues (pingcap#41347) close pingcap#39786 --------- Signed-off-by: YangKeao <[email protected]> Signed-off-by: Weizhen Wang <[email protected]> Co-authored-by: Weizhen Wang <[email protected]> Co-authored-by: tiancaiamao <[email protected]> Co-authored-by: fzzf678 <[email protected]> Co-authored-by: Yuanjia Zhang <[email protected]> Co-authored-by: crazycs <[email protected]> Co-authored-by: Mattias Jonsson <[email protected]> Co-authored-by: zzm <[email protected]> Co-authored-by: Song Gao <[email protected]> Co-authored-by: BornChanger <[email protected]> Co-authored-by: Jk Xu <[email protected]> Co-authored-by: Yang Zhang <[email protected]> Co-authored-by: Jianjun Liao <[email protected]> Co-authored-by: lance6716 <[email protected]> Co-authored-by: YangKeao <[email protected]> Co-authored-by: tangenta <[email protected]> Co-authored-by: xiongjiwei <[email protected]> Co-authored-by: Hangjie Mo <[email protected]> Co-authored-by: you06 <[email protected]> Co-authored-by: djshow832 <[email protected]> Co-authored-by: Hu# <[email protected]> Co-authored-by: hongyunyan <[email protected]> Co-authored-by: ShuNing <[email protected]> Co-authored-by: Zak Zhao <[email protected]> Co-authored-by: Yujie Xia <[email protected]> Co-authored-by: Yifan Xu <[email protected]> Co-authored-by: 王超 <[email protected]> Co-authored-by: Lynn <[email protected]> Co-authored-by: Chunzhu Li <[email protected]> Co-authored-by: dsdashun <[email protected]> Co-authored-by: TonsnakeLin <[email protected]> Co-authored-by: wjHuang <[email protected]> Co-authored-by: hehechen <[email protected]> Co-authored-by: Daniël van Eeden <[email protected]> Co-authored-by: MoCuishle28 <[email protected]> Co-authored-by: guo-shaoge <[email protected]> Co-authored-by: iosmanthus <[email protected]> Co-authored-by: winkyao <[email protected]> Co-authored-by: xufei <[email protected]> Co-authored-by: glorv <[email protected]> Co-authored-by: Zhenchi <[email protected]> Co-authored-by: Chengpeng Yan <[email protected]> Co-authored-by: JmPotato <[email protected]> Co-authored-by: Zhigao Tong <[email protected]> Co-authored-by: ystaticy <[email protected]> Co-authored-by: Shenghui Wu <[email protected]> Co-authored-by: fengou1 <[email protected]> Co-authored-by: Chen Ding <[email protected]> Co-authored-by: ghazalfamilyusa <[email protected]> Co-authored-by: disksing <[email protected]> Co-authored-by: 山岚 <[email protected]> Co-authored-by: okJiang <[email protected]> Co-authored-by: Yongbo Jiang <[email protected]> Co-authored-by: Lucas <[email protected]> Co-authored-by: MyonKeminta <[email protected]> Co-authored-by: Yexiang Zhang <[email protected]> Co-authored-by: yanweiqi <[email protected]> Co-authored-by: Ti Chi Robot <[email protected]> Co-authored-by: Zhou Kunqin <[email protected]> Co-authored-by: Arenatlx <[email protected]> Co-authored-by: Benjamin2037 <[email protected]> Co-authored-by: Lars Lehtonen <[email protected]> Co-authored-by: cfzjywxk <[email protected]> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
blacktear23
pushed a commit
to blacktear23/tidb
that referenced
this pull request
Feb 15, 2023
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What problem does this PR solve?
Issue Number: close #38535
Problem Summary:
This is a manual merge of the feature branch 'feature/reorganize-partition' containing #38460, #38508, #40473, #40543, #40714 and #40258.
What is changed and how it works?
Somehow the feature branch rewrote the commits from master when updating, so this is a manual squash of the content of the feature branch, where each PR has been reviewed and approved.
Check List
Tests
Side effects
Documentation
Release note
Please refer to Release Notes Language Style Guide to write a quality release note.