From 929d3cc6d1dee9649ac066ba6d1be67a2347138e Mon Sep 17 00:00:00 2001 From: YangKeao Date: Wed, 9 Sep 2020 19:27:24 +0800 Subject: [PATCH 01/32] update v4.0.6 release notes at 2020-09-09T19:27:24 Signed-off-by: YangKeao --- releases/4.0.6.md | 132 ++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 132 insertions(+) create mode 100644 releases/4.0.6.md diff --git a/releases/4.0.6.md b/releases/4.0.6.md new file mode 100644 index 0000000000000..3895270c17fe5 --- /dev/null +++ b/releases/4.0.6.md @@ -0,0 +1,132 @@ +--- +title: TiDB v4.0.6 Release Notes +category: Releases +aliases: ['/docs/dev/releases/v4.0.6/'] +--- + +# TiDB v4.0.6 Release Notes + +Release date: September 09, 2020 + +TiDB version: v4.0.6 + +## Improvements + ++ TiDB + + - Replace error code and message with standard error. [#19888](https://github.com/pingcap/tidb/pull/19888) + - Table: improve the write performance of partition table [#19649](https://github.com/pingcap/tidb/pull/19649) + - Optimize the performance of encoding plan. [#19279](https://github.com/pingcap/tidb/pull/19279) + - Record more RPC runtime information in cop runtime stats [#19264](https://github.com/pingcap/tidb/pull/19264) + ++ TiFlash + + - Add some metrics about apply Region snapshots and ingest SST files [#1088](https://github.com/pingcap/tics/pull/1088) + - Fix the problem that CN check doesn't work on https_port and metrics_port [#1064](https://github.com/pingcap/tics/pull/1064) + +## Bug Fixes + ++ TiDB + + - Fix issue of tikv_cop_wait time in metric profile. [#19881](https://github.com/pingcap/tidb/pull/19881) + - Fix wrong result of `SHOW GRANTS` [#19834](https://github.com/pingcap/tidb/pull/19834) + - Fix incorrect query result for `!= all (subq)`. [#19831](https://github.com/pingcap/tidb/pull/19831) + - Forbidden creating table in metrics_schema and performance_schema [#19792](https://github.com/pingcap/tidb/pull/19792) + - Fix bug of converting enum and set [#19778](https://github.com/pingcap/tidb/pull/19778) + - Add privilege check for `SHOW STATS_META`, `SHOW STATS_BUCKET`. [#19760](https://github.com/pingcap/tidb/pull/19760) + - Expression: fix unmatched column lengths errors caused by `builtinGreatestStringSig` and `builtinLeastStringSig` [#19758](https://github.com/pingcap/tidb/pull/19758) + - Fallback vectorize control expressions [#19749](https://github.com/pingcap/tidb/pull/19749) + - Executor: fix errors in Apply when the type of correlation column is `bit` [#19692](https://github.com/pingcap/tidb/pull/19692) + - Fix issue of query processlist and cluster_log bug in mysql8 client. [#19690](https://github.com/pingcap/tidb/pull/19690) + - Fix issue of same type plans with different plan digest. [#19684](https://github.com/pingcap/tidb/pull/19684) + - Forbidden changing decimal to int [#19682](https://github.com/pingcap/tidb/pull/19682) + - Executor: fix the issue that `SELECT ... INTO OUTFILE` returns runtim… [#19672](https://github.com/pingcap/tidb/pull/19672) + - Expression: fix incorrect implementation in `builtinRealIsFalseSig` [#19670](https://github.com/pingcap/tidb/pull/19670) + - Fix check partition expression miss the parentheses expression [#19614](https://github.com/pingcap/tidb/pull/19614) + - Fix an query error when there is an Apply upon HashJoin [#19611](https://github.com/pingcap/tidb/pull/19611) + - Fix incorrect result of vectorized casting real as time [#19594](https://github.com/pingcap/tidb/pull/19594) + - Fix `SHOW GRANTS` can show grants for not existed user. [#19588](https://github.com/pingcap/tidb/pull/19588) + - Fix an query error when there is an Apply upon IndexLookupJoin [#19566](https://github.com/pingcap/tidb/pull/19566) + - Fix wrong results when convert apply to hash join on partition table. [#19546](https://github.com/pingcap/tidb/pull/19546) + - Executor: fix incorrect results when there is an IndexLookUp under the inner side of an Apply [#19508](https://github.com/pingcap/tidb/pull/19508) + - Fix unexpected panic when using view [#19491](https://github.com/pingcap/tidb/pull/19491) + - Fix incorrect result of anti-semi-join query [#19477](https://github.com/pingcap/tidb/pull/19477) + - Drop stats should delete topn. [#19465](https://github.com/pingcap/tidb/pull/19465) + - Fix wrong result caused by mistaken usage of batch point get. [#19460](https://github.com/pingcap/tidb/pull/19460) + - Fix a bug that can't find column in indexLookupJoin with virtual generated column [#19439](https://github.com/pingcap/tidb/pull/19439) + - Fix the different plans between select and update query. [#19403](https://github.com/pingcap/tidb/pull/19403) + - Fix data race for tiflash work index in region cache [#19362](https://github.com/pingcap/tidb/pull/19362) + - Bug fix for logarithm functions [#19291](https://github.com/pingcap/tidb/pull/19291) + - Fix unexpected error when spilling disk. [#19272](https://github.com/pingcap/tidb/pull/19272) + - Make single partition table support index join on the inner side. [#19197](https://github.com/pingcap/tidb/pull/19197) + - Fix wrong hash key for decimal [#19188](https://github.com/pingcap/tidb/pull/19188) + ++ TiFlash + + - Fix the issue that TiFlash throw exceptions after modifying column nullable attribute [#1081](https://github.com/pingcap/tics/pull/1081) + - Fix the issue that after renaming the primary key column in previous versions, TiFlash may not start after upgrading to v4.0.4/v4.0.5 [#1072](https://github.com/pingcap/tics/pull/1072) + - Fix wrong result of FROM_UNIXTIME when input is NULL [#1047](https://github.com/pingcap/tics/pull/1047) + - Fix the issue that TiFlash is not available after users applied unsupported column data type modifications [#1009](https://github.com/pingcap/tics/pull/1009) + +## Others + ++ TiDB + + - Fix the issue that will raise no regions error when table range end key and region endKey are same. [#19895](https://github.com/pingcap/tidb/pull/19895) + - Fix an issue that unexpect sucess partition alter [#19891](https://github.com/pingcap/tidb/pull/19891) + - Support adjust the concurrency on union executor. [#19886](https://github.com/pingcap/tidb/pull/19886) + - Fix wrong default max allowed packet for push downed expression. [#19876](https://github.com/pingcap/tidb/pull/19876) + - Fix wrong behavior for `max/min` on ENUM/SET column. [#19869](https://github.com/pingcap/tidb/pull/19869) + - Add sql digest for process list. [#19829](https://github.com/pingcap/tidb/pull/19829) + - Switch to pessimistic txn mode for autocommit statement retry [#19796](https://github.com/pingcap/tidb/pull/19796) + - Fix read failure from system tables `tiflash_segments` and `tiflash_tables` when some tiflash node is down [#19748](https://github.com/pingcap/tidb/pull/19748) + - Executor: fix file exists errors in tests for `select into outfile` [#19725](https://github.com/pingcap/tidb/pull/19725) + - Support %r, %T data format in Str_to_date() [#19693](https://github.com/pingcap/tidb/pull/19693) + - Support out join in broadcast join [#19664](https://github.com/pingcap/tidb/pull/19664) + - Fix wrong result for aggregation count(col) [#19628](https://github.com/pingcap/tidb/pull/19628) + - `SELECT INTO OUTFILE` now requires the FILE privilege. [#19577](https://github.com/pingcap/tidb/pull/19577) + - Not needed, this PR just adds a test case. [#19559](https://github.com/pingcap/tidb/pull/19559) + - Executor: rename test files for `select into outfile` to avoid `file exists error` [#19551](https://github.com/pingcap/tidb/pull/19551) + - Support stddev_pop function. [#19541](https://github.com/pingcap/tidb/pull/19541) + - Avoid DDL retry taking too long [#19488](https://github.com/pingcap/tidb/pull/19488) + - Allow `alter table db.t1 add constraint fk foreign key (c2) references t2(c1)` like statements without first executing `use db` [#19471](https://github.com/pingcap/tidb/pull/19471) + - Fix INFORMATION_SCHEMA.CLUSTER_HARDWARE dose not have raid0 devices information [#19457](https://github.com/pingcap/tidb/pull/19457) + - Invalid SQL statements (dispatch errors) have been changed from an Error to an Info message in the server log file. [#19454](https://github.com/pingcap/tidb/pull/19454) + - Fix a runtime error in `TRUNCATE` [#19445](https://github.com/pingcap/tidb/pull/19445) + - Add `TiDB-Runtime` dashboard [#19396](https://github.com/pingcap/tidb/pull/19396) + - Ddl: exit add index on generated column with `case-when` expression parse error [#19395](https://github.com/pingcap/tidb/pull/19395) + - Fix issue 19371 - PREPARE statement FROM @Var (where Var contains uppercase characters fail) [#19378](https://github.com/pingcap/tidb/pull/19378) + - Improve compatibility for ALTER TABLE algorithms [#19364](https://github.com/pingcap/tidb/pull/19364) + - Fix a schema charset modification panic bug in an uppercase schema. [#19302](https://github.com/pingcap/tidb/pull/19302) + - Planner: encode insert/delete/update plan in slow log plan field. [#19269](https://github.com/pingcap/tidb/pull/19269) + - Fix inconsistence of Plan between information_schema.statements_summary and explain, which contains tikv/tiflash info. [#19159](https://github.com/pingcap/tidb/pull/19159) + ++ TiKV + + - Optimize QPS drop when doing UnsafeDestroyRange [#8627](https://github.com/tikv/tikv/pull/8627) + - Fix the estimation error for a non-index column with collation enabled. [#8620](https://github.com/tikv/tikv/pull/8620) + - Error-code: support to generate metafile [#8619](https://github.com/tikv/tikv/pull/8619) + - Add perf statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) + - Fix the deadlock between the PD client thread and other threads calling PD sync requests. [#8612](https://github.com/tikv/tikv/pull/8612) + - Fix a panic issue if a TiKV runs very slow during conf change. [#8497](https://github.com/tikv/tikv/pull/8497) + - Add perf context panel for grafana template [#8467](https://github.com/tikv/tikv/pull/8467) + - Update jemalloc to 5.2.1 [#8463](https://github.com/tikv/tikv/pull/8463) + - Fix the issue that green GC may miss locks during transferring regions. [#8460](https://github.com/tikv/tikv/pull/8460) + - Support float CPU quota in cgroup. [#8427](https://github.com/tikv/tikv/pull/8427) + ++ PD + + - Dashboard: update to v2020.09.08.1 [#2928](https://github.com/pingcap/pd/pull/2928) + - Add `initial-cluster-token` configuration to avoid different clusters communicate during bootstrap [#2922](https://github.com/pingcap/pd/pull/2922) + - Change back to the original way to control the low space threshold [#2875](https://github.com/pingcap/pd/pull/2875) + - Fix the unit of store limit rate when the mode is auto [#2826](https://github.com/pingcap/pd/pull/2826) + - Add service gc safepoit commands [#2813](https://github.com/pingcap/pd/pull/2813) + - Fix the issue that no filtered unhealthy store in `summaryStoresLoad` [#2805](https://github.com/pingcap/pd/pull/2805) + - Fix a bug that pd will not pass the vet check in go1.15. [#2753](https://github.com/pingcap/pd/pull/2753) + ++ TiFlash + + - `Do not optimize applying snapshot by multi-thread when raftstore.snap-handle-pool-size is 0` [#1086](https://github.com/pingcap/tics/pull/1086) + - `Fix bug causes segment fault while computing table sync status` [#1077](https://github.com/pingcap/tics/pull/1077) + - For invalid collation, treated as `utf8mb4_bin` in TiFlash [#1069](https://github.com/pingcap/tics/pull/1069) + - Added some Grafana panels about write stall, and added some settings to avoid write stall. [#1051](https://github.com/pingcap/tics/pull/1051) From adba592005663506b8259b000932b98f6e0080e3 Mon Sep 17 00:00:00 2001 From: Ran Date: Wed, 9 Sep 2020 20:30:38 +0800 Subject: [PATCH 02/32] modify 4.0.6 file name; add in toc; update format Signed-off-by: Ran --- TOC.md | 1 + releases/{4.0.6.md => release-4.0.6.md} | 12 +++++------- releases/release-notes.md | 1 + 3 files changed, 7 insertions(+), 7 deletions(-) rename releases/{4.0.6.md => release-4.0.6.md} (97%) diff --git a/TOC.md b/TOC.md index 7b3b47ea8db4b..060f09465d4e9 100644 --- a/TOC.md +++ b/TOC.md @@ -511,6 +511,7 @@ + Release Notes + [All Releases](/releases/release-notes.md) + v4.0 + + [4.0.6](/releases/release-4.0.6.md) + [4.0.5](/releases/release-4.0.5.md) + [4.0.4](/releases/release-4.0.4.md) + [4.0.3](/releases/release-4.0.3.md) diff --git a/releases/4.0.6.md b/releases/release-4.0.6.md similarity index 97% rename from releases/4.0.6.md rename to releases/release-4.0.6.md index 3895270c17fe5..f4b389ef8b95d 100644 --- a/releases/4.0.6.md +++ b/releases/release-4.0.6.md @@ -1,20 +1,18 @@ --- -title: TiDB v4.0.6 Release Notes -category: Releases -aliases: ['/docs/dev/releases/v4.0.6/'] +title: TiDB 4.0.6 Release Notes --- -# TiDB v4.0.6 Release Notes +# TiDB 4.0.6 Release Notes -Release date: September 09, 2020 +Release date: September 9, 2020 -TiDB version: v4.0.6 +TiDB version: 4.0.6 ## Improvements + TiDB - - Replace error code and message with standard error. [#19888](https://github.com/pingcap/tidb/pull/19888) + - Replace error code and message with standard error [#19888](https://github.com/pingcap/tidb/pull/19888) - Table: improve the write performance of partition table [#19649](https://github.com/pingcap/tidb/pull/19649) - Optimize the performance of encoding plan. [#19279](https://github.com/pingcap/tidb/pull/19279) - Record more RPC runtime information in cop runtime stats [#19264](https://github.com/pingcap/tidb/pull/19264) diff --git a/releases/release-notes.md b/releases/release-notes.md index 7398fea8f2779..1255eaa950f18 100644 --- a/releases/release-notes.md +++ b/releases/release-notes.md @@ -7,6 +7,7 @@ aliases: ['/docs/dev/releases/release-notes/','/docs/dev/releases/rn/'] ## 4.0 +- [4.0.6](/releases/release-4.0.6.md) - [4.0.5](/releases/release-4.0.5.md) - [4.0.4](/releases/release-4.0.4.md) - [4.0.3](/releases/release-4.0.3.md) From 54dbbb3e6b9d15fc55db1c7d58af04354cdc55cf Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 10:19:22 +0800 Subject: [PATCH 03/32] update PD added by lhy1024 Signed-off-by: Ran --- releases/release-4.0.6.md | 18 ++++++++++-------- 1 file changed, 10 insertions(+), 8 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index f4b389ef8b95d..5bd59476acf7e 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -17,12 +17,17 @@ TiDB version: 4.0.6 - Optimize the performance of encoding plan. [#19279](https://github.com/pingcap/tidb/pull/19279) - Record more RPC runtime information in cop runtime stats [#19264](https://github.com/pingcap/tidb/pull/19264) ++ PD + + - Dashboard: update to v2020.09.08.1 [#2928](https://github.com/pingcap/pd/pull/2928) + - metrics: add more metrics for region and store heartbeat [#2891](https://github.com/tikv/pd/pull/2891) + - Change back to the original way to control the low space threshold [#2875](https://github.com/pingcap/pd/pull/2875) + - Support standard error code [#2918](https://github.com/tikv/pd/pull/2918) [#2911](https://github.com/tikv/pd/pull/2911) [#2913](https://github.com/tikv/pd/pull/2913) [#2915](https://github.com/tikv/pd/pull/2915) [#2912](https://github.com/tikv/pd/pull/2912) [#2907](https://github.com/tikv/pd/pull/2907) [#2906](https://github.com/tikv/pd/pull/2906) [#2903](https://github.com/tikv/pd/pull/2903) [#2806](https://github.com/tikv/pd/pull/2806) [#2900](https://github.com/tikv/pd/pull/2900) [#2902](https://github.com/tikv/pd/pull/2902) + + TiFlash - Add some metrics about apply Region snapshots and ingest SST files [#1088](https://github.com/pingcap/tics/pull/1088) - - Fix the problem that CN check doesn't work on https_port and metrics_port [#1064](https://github.com/pingcap/tics/pull/1064) - -## Bug Fixes + - Fix the problem that CN check doesn't work on https_port and metrics_port [#1064](https://github.com/pingcap/tics/pull/1064)## Bug Fixes + TiDB @@ -114,13 +119,10 @@ TiDB version: 4.0.6 + PD - - Dashboard: update to v2020.09.08.1 [#2928](https://github.com/pingcap/pd/pull/2928) - Add `initial-cluster-token` configuration to avoid different clusters communicate during bootstrap [#2922](https://github.com/pingcap/pd/pull/2922) - - Change back to the original way to control the low space threshold [#2875](https://github.com/pingcap/pd/pull/2875) - Fix the unit of store limit rate when the mode is auto [#2826](https://github.com/pingcap/pd/pull/2826) - - Add service gc safepoit commands [#2813](https://github.com/pingcap/pd/pull/2813) - - Fix the issue that no filtered unhealthy store in `summaryStoresLoad` [#2805](https://github.com/pingcap/pd/pull/2805) - - Fix a bug that pd will not pass the vet check in go1.15. [#2753](https://github.com/pingcap/pd/pull/2753) + - Fix the issue that some scheduler persist config without solving error [#2818](https://github.com/tikv/pd/pull/2818) + - fix empty http response in scheduler [#2871](https://github.com/tikv/pd/pull/2871) [#2874](https://github.com/tikv/pd/pull/2874) + TiFlash From a99aff9ddae89e042e5e8bc9e7c670a097370128 Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 13:11:52 +0800 Subject: [PATCH 04/32] Apply suggestions from code review Co-authored-by: lhy1024 Co-authored-by: Connor --- releases/release-4.0.6.md | 28 ++++++++++++++++++++++++++-- 1 file changed, 26 insertions(+), 2 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 5bd59476acf7e..5ada3e8a33dc8 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -7,7 +7,14 @@ title: TiDB 4.0.6 Release Notes Release date: September 9, 2020 TiDB version: 4.0.6 - +## Feature + ++ TiDB Dashboard + - Add query editor and execution UI (experimental) [#713](https://github.com/pingcap-incubator/tidb-dashboard/pull/713) + - Support store location topology visualization [#719](https://github.com/pingcap-incubator/tidb-dashboard/pull/719) + - Add cluster configuration UI (experimental) [#733](https://github.com/pingcap-incubator/tidb-dashboard/pull/733) + - Support sharing current session [#741](https://github.com/pingcap-incubator/tidb-dashboard/pull/741) + - Support displaying number of execution plans in Statement list [#746](https://github.com/pingcap-incubator/tidb-dashboard/pull/746) ## Improvements + TiDB @@ -17,6 +24,13 @@ TiDB version: 4.0.6 - Optimize the performance of encoding plan. [#19279](https://github.com/pingcap/tidb/pull/19279) - Record more RPC runtime information in cop runtime stats [#19264](https://github.com/pingcap/tidb/pull/19264) ++ TiKV + + - Optimize QPS drop when doing UnsafeDestroyRange [#8627](https://github.com/tikv/tikv/pull/8627) + - Support to generate metafile of error codes [#8619](https://github.com/tikv/tikv/pull/8619) + - Add perf statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) + - Add perf context panel for grafana template [#8467](https://github.com/tikv/tikv/pull/8467) + + PD - Dashboard: update to v2020.09.08.1 [#2928](https://github.com/pingcap/pd/pull/2928) @@ -64,6 +78,16 @@ TiDB version: 4.0.6 - Make single partition table support index join on the inner side. [#19197](https://github.com/pingcap/tidb/pull/19197) - Fix wrong hash key for decimal [#19188](https://github.com/pingcap/tidb/pull/19188) ++ TiKV + + - Fix the estimation error for a non-index column with collation enabled. [#8620](https://github.com/tikv/tikv/pull/8620) + - Fix the issue that green GC may miss locks during transferring regions. [#8460](https://github.com/tikv/tikv/pull/8460) + - Fix the CDC incorrect resolved TS timeout. [#8573](https://github.com/tikv/tikv/pull/8573) + - Fix a panic issue if a TiKV runs very slow during conf change. [#8497](https://github.com/tikv/tikv/pull/8497) + - Fix the deadlock between the PD client thread and other threads calling PD sync requests. [#8612](https://github.com/tikv/tikv/pull/8612) + - Update jemalloc to 5.2.1 to address memory allocation problem in huge page. [#8463](https://github.com/tikv/tikv/pull/8463) + - Fix unified thread pool hang for long running query. [#8427](https://github.com/tikv/tikv/pull/8427) + + TiFlash - Fix the issue that TiFlash throw exceptions after modifying column nullable attribute [#1081](https://github.com/pingcap/tics/pull/1081) @@ -71,7 +95,7 @@ TiDB version: 4.0.6 - Fix wrong result of FROM_UNIXTIME when input is NULL [#1047](https://github.com/pingcap/tics/pull/1047) - Fix the issue that TiFlash is not available after users applied unsupported column data type modifications [#1009](https://github.com/pingcap/tics/pull/1009) -## Others +## Bug Fix + TiDB From fe3e3ee09f6783a0cf3d2873cf2a17a8ec7e9c14 Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 13:47:07 +0800 Subject: [PATCH 05/32] apply AilinKid's comments Signed-off-by: Ran --- releases/release-4.0.6.md | 115 +++++++++++++++++++------------------- 1 file changed, 57 insertions(+), 58 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 5bd59476acf7e..82491e52d07d4 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -13,9 +13,11 @@ TiDB version: 4.0.6 + TiDB - Replace error code and message with standard error [#19888](https://github.com/pingcap/tidb/pull/19888) - - Table: improve the write performance of partition table [#19649](https://github.com/pingcap/tidb/pull/19649) - - Optimize the performance of encoding plan. [#19279](https://github.com/pingcap/tidb/pull/19279) + - Improve the write performance of partition table [#19649](https://github.com/pingcap/tidb/pull/19649) - Record more RPC runtime information in cop runtime stats [#19264](https://github.com/pingcap/tidb/pull/19264) + - Forbidden creating table in metrics_schema and performance_schema [#19792](https://github.com/pingcap/tidb/pull/19792) + - Support adjust the concurrency on union executor [#19886](https://github.com/pingcap/tidb/pull/19886) + - Support out join in broadcast join [#19664](https://github.com/pingcap/tidb/pull/19664) + PD @@ -29,40 +31,52 @@ TiDB version: 4.0.6 - Add some metrics about apply Region snapshots and ingest SST files [#1088](https://github.com/pingcap/tics/pull/1088) - Fix the problem that CN check doesn't work on https_port and metrics_port [#1064](https://github.com/pingcap/tics/pull/1064)## Bug Fixes +## Bug Fixes + + TiDB - - Fix issue of tikv_cop_wait time in metric profile. [#19881](https://github.com/pingcap/tidb/pull/19881) - - Fix wrong result of `SHOW GRANTS` [#19834](https://github.com/pingcap/tidb/pull/19834) - - Fix incorrect query result for `!= all (subq)`. [#19831](https://github.com/pingcap/tidb/pull/19831) - - Forbidden creating table in metrics_schema and performance_schema [#19792](https://github.com/pingcap/tidb/pull/19792) - - Fix bug of converting enum and set [#19778](https://github.com/pingcap/tidb/pull/19778) - - Add privilege check for `SHOW STATS_META`, `SHOW STATS_BUCKET`. [#19760](https://github.com/pingcap/tidb/pull/19760) - - Expression: fix unmatched column lengths errors caused by `builtinGreatestStringSig` and `builtinLeastStringSig` [#19758](https://github.com/pingcap/tidb/pull/19758) + - Fix an issue of tikv_cop_wait time in metric profile [#19881](https://github.com/pingcap/tidb/pull/19881) + - Fix the wrong result of `SHOW GRANTS` [#19834](https://github.com/pingcap/tidb/pull/19834) + - Fix the incorrect query result for `!= ALL (subq)` [#19831](https://github.com/pingcap/tidb/pull/19831) + - Fix a bug of converting enum and set [#19778](https://github.com/pingcap/tidb/pull/19778) + - Add a privilege check for `SHOW STATS_META`, `SHOW STATS_BUCKET` [#19760](https://github.com/pingcap/tidb/pull/19760) + - Fix unmatched column lengths errors caused by `builtinGreatestStringSig` and `builtinLeastStringSig` [#19758](https://github.com/pingcap/tidb/pull/19758) - Fallback vectorize control expressions [#19749](https://github.com/pingcap/tidb/pull/19749) - - Executor: fix errors in Apply when the type of correlation column is `bit` [#19692](https://github.com/pingcap/tidb/pull/19692) - - Fix issue of query processlist and cluster_log bug in mysql8 client. [#19690](https://github.com/pingcap/tidb/pull/19690) - - Fix issue of same type plans with different plan digest. [#19684](https://github.com/pingcap/tidb/pull/19684) - - Forbidden changing decimal to int [#19682](https://github.com/pingcap/tidb/pull/19682) - - Executor: fix the issue that `SELECT ... INTO OUTFILE` returns runtim… [#19672](https://github.com/pingcap/tidb/pull/19672) - - Expression: fix incorrect implementation in `builtinRealIsFalseSig` [#19670](https://github.com/pingcap/tidb/pull/19670) - - Fix check partition expression miss the parentheses expression [#19614](https://github.com/pingcap/tidb/pull/19614) - - Fix an query error when there is an Apply upon HashJoin [#19611](https://github.com/pingcap/tidb/pull/19611) - - Fix incorrect result of vectorized casting real as time [#19594](https://github.com/pingcap/tidb/pull/19594) - - Fix `SHOW GRANTS` can show grants for not existed user. [#19588](https://github.com/pingcap/tidb/pull/19588) - - Fix an query error when there is an Apply upon IndexLookupJoin [#19566](https://github.com/pingcap/tidb/pull/19566) - - Fix wrong results when convert apply to hash join on partition table. [#19546](https://github.com/pingcap/tidb/pull/19546) - - Executor: fix incorrect results when there is an IndexLookUp under the inner side of an Apply [#19508](https://github.com/pingcap/tidb/pull/19508) - - Fix unexpected panic when using view [#19491](https://github.com/pingcap/tidb/pull/19491) - - Fix incorrect result of anti-semi-join query [#19477](https://github.com/pingcap/tidb/pull/19477) - - Drop stats should delete topn. [#19465](https://github.com/pingcap/tidb/pull/19465) - - Fix wrong result caused by mistaken usage of batch point get. [#19460](https://github.com/pingcap/tidb/pull/19460) - - Fix a bug that can't find column in indexLookupJoin with virtual generated column [#19439](https://github.com/pingcap/tidb/pull/19439) - - Fix the different plans between select and update query. [#19403](https://github.com/pingcap/tidb/pull/19403) - - Fix data race for tiflash work index in region cache [#19362](https://github.com/pingcap/tidb/pull/19362) - - Bug fix for logarithm functions [#19291](https://github.com/pingcap/tidb/pull/19291) - - Fix unexpected error when spilling disk. [#19272](https://github.com/pingcap/tidb/pull/19272) - - Make single partition table support index join on the inner side. [#19197](https://github.com/pingcap/tidb/pull/19197) - - Fix wrong hash key for decimal [#19188](https://github.com/pingcap/tidb/pull/19188) + - Fix errors in `Apply` when the type of correlation column is `Bit` [#19692](https://github.com/pingcap/tidb/pull/19692) + - Fix an issue of query processlist and cluster_log bug in mysql8 client [#19690](https://github.com/pingcap/tidb/pull/19690) + - Fix an issue of same type plans with different plan digest [#19684](https://github.com/pingcap/tidb/pull/19684) + - Forbidden changing `Decimal` to `Int` [#19682](https://github.com/pingcap/tidb/pull/19682) + - Fix an issue that `SELECT ... INTO OUTFILE` returns runtime error [#19672](https://github.com/pingcap/tidb/pull/19672) + - Fix an incorrect implementation in `builtinRealIsFalseSig` [#19670](https://github.com/pingcap/tidb/pull/19670) + - Fix partition expression check missing the parentheses expression [#19614](https://github.com/pingcap/tidb/pull/19614) + - Fix a query error when there is an `Apply` upon `HashJoin` [#19611](https://github.com/pingcap/tidb/pull/19611) + - Fix an incorrect result of vectorized casting `Real` as `Time` [#19594](https://github.com/pingcap/tidb/pull/19594) + - Fix `SHOW GRANTS` can show grants for not existed user [#19588](https://github.com/pingcap/tidb/pull/19588) + - Fix a query error when there is an `Apply` upon `IndexLookupJoin` [#19566](https://github.com/pingcap/tidb/pull/19566) + - Fix wrong results when convert `Apply` to `HashJoin` on partition table [#19546](https://github.com/pingcap/tidb/pull/19546) + - Fix incorrect results when there is an `IndexLookUp` under the inner side of an `Apply` [#19508](https://github.com/pingcap/tidb/pull/19508) + - Fix a unexpected panic when using view [#19491](https://github.com/pingcap/tidb/pull/19491) + - Fix an incorrect result of `anti-semi-join` query [#19477](https://github.com/pingcap/tidb/pull/19477) + - Fix dropping stats should delete topN [#19465](https://github.com/pingcap/tidb/pull/19465) + - Fix a wrong result caused by mistaken usage of batch point get [#19460](https://github.com/pingcap/tidb/pull/19460) + - Fix a bug that it can't find column in `indexLookupJoin` with virtual generated column [#19439](https://github.com/pingcap/tidb/pull/19439) + - Fix different plans between select and update query [#19403](https://github.com/pingcap/tidb/pull/19403) + - Fix a data race for tiflash work index in region cache [#19362](https://github.com/pingcap/tidb/pull/19362) + - Fix logarithm functions [#19291](https://github.com/pingcap/tidb/pull/19291) + - Fix a unexpected error when TiDB spilling to disk [#19272](https://github.com/pingcap/tidb/pull/19272) + - Make single partition table support index join on the inner side [#19197](https://github.com/pingcap/tidb/pull/19197) + - Fix the wrong hash key for decimal [#19188](https://github.com/pingcap/tidb/pull/19188) + - Fix an issue that TiDB will raise no-regions error when table endKey and region endKey are same [#19895](https://github.com/pingcap/tidb/pull/19895) + - Fix an issue that unexpect sucess to alter partition [#19891](https://github.com/pingcap/tidb/pull/19891) + - Fix a wrong default max allowed packet for push downed expression [#19876](https://github.com/pingcap/tidb/pull/19876) + - Fix a wrong behavior for `Max/Min` on `ENUM/SET` column [#19869](https://github.com/pingcap/tidb/pull/19869) + - Fix read failure from system tables `tiflash_segments` and `tiflash_tables` when some tiflash node is down [#19748](https://github.com/pingcap/tidb/pull/19748) + - Fix a wrong result for aggregation `Count(col)` [#19628](https://github.com/pingcap/tidb/pull/19628) + - Fix a runtime error in `TRUNCATE` [#19445](https://github.com/pingcap/tidb/pull/19445) + - Fix `PREPARE` statement FROM `@Var` will fail when `Var` contains uppercase characters [#19378](https://github.com/pingcap/tidb/pull/19378) + - Fix a bug that schema charset modification in an uppercase schema will cause panic [#19302](https://github.com/pingcap/tidb/pull/19302) + - Fix a inconsistence of plan between `information_schema.statements_summary` and `explain`, which contains tikv/tiflash info [#19159](https://github.com/pingcap/tidb/pull/19159) + - Fix the file exists errors in tests for `select into outfile` [#19725](https://github.com/pingcap/tidb/pull/19725) + TiFlash @@ -75,34 +89,19 @@ TiDB version: 4.0.6 + TiDB - - Fix the issue that will raise no regions error when table range end key and region endKey are same. [#19895](https://github.com/pingcap/tidb/pull/19895) - - Fix an issue that unexpect sucess partition alter [#19891](https://github.com/pingcap/tidb/pull/19891) - - Support adjust the concurrency on union executor. [#19886](https://github.com/pingcap/tidb/pull/19886) - - Fix wrong default max allowed packet for push downed expression. [#19876](https://github.com/pingcap/tidb/pull/19876) - - Fix wrong behavior for `max/min` on ENUM/SET column. [#19869](https://github.com/pingcap/tidb/pull/19869) - - Add sql digest for process list. [#19829](https://github.com/pingcap/tidb/pull/19829) + - Add sql digest for process list [#19829](https://github.com/pingcap/tidb/pull/19829) - Switch to pessimistic txn mode for autocommit statement retry [#19796](https://github.com/pingcap/tidb/pull/19796) - - Fix read failure from system tables `tiflash_segments` and `tiflash_tables` when some tiflash node is down [#19748](https://github.com/pingcap/tidb/pull/19748) - - Executor: fix file exists errors in tests for `select into outfile` [#19725](https://github.com/pingcap/tidb/pull/19725) - - Support %r, %T data format in Str_to_date() [#19693](https://github.com/pingcap/tidb/pull/19693) - - Support out join in broadcast join [#19664](https://github.com/pingcap/tidb/pull/19664) - - Fix wrong result for aggregation count(col) [#19628](https://github.com/pingcap/tidb/pull/19628) - - `SELECT INTO OUTFILE` now requires the FILE privilege. [#19577](https://github.com/pingcap/tidb/pull/19577) - - Not needed, this PR just adds a test case. [#19559](https://github.com/pingcap/tidb/pull/19559) - - Executor: rename test files for `select into outfile` to avoid `file exists error` [#19551](https://github.com/pingcap/tidb/pull/19551) - - Support stddev_pop function. [#19541](https://github.com/pingcap/tidb/pull/19541) - - Avoid DDL retry taking too long [#19488](https://github.com/pingcap/tidb/pull/19488) - - Allow `alter table db.t1 add constraint fk foreign key (c2) references t2(c1)` like statements without first executing `use db` [#19471](https://github.com/pingcap/tidb/pull/19471) - - Fix INFORMATION_SCHEMA.CLUSTER_HARDWARE dose not have raid0 devices information [#19457](https://github.com/pingcap/tidb/pull/19457) - - Invalid SQL statements (dispatch errors) have been changed from an Error to an Info message in the server log file. [#19454](https://github.com/pingcap/tidb/pull/19454) - - Fix a runtime error in `TRUNCATE` [#19445](https://github.com/pingcap/tidb/pull/19445) + - Support `%r`, `%T` data format in `Str_to_date()` [#19693](https://github.com/pingcap/tidb/pull/19693) + - Make `SELECT INTO OUTFILE` require the file privilege [#19577](https://github.com/pingcap/tidb/pull/19577) + - Support stddev_pop function [#19541](https://github.com/pingcap/tidb/pull/19541) + - Make DDL avoid taking too long in retry [#19488](https://github.com/pingcap/tidb/pull/19488) + - Make statements like `alter table db.t1 add constraint fk foreign key (c2) references t2(c1)` execute without first executing `use db` [#19471](https://github.com/pingcap/tidb/pull/19471) + - Fix `INFORMATION_SCHEMA.CLUSTER_HARDWARE` does not have raid devices information [#19457](https://github.com/pingcap/tidb/pull/19457) + - Make dispatch errors be changed from an Error to an Info message in the server log file [#19454](https://github.com/pingcap/tidb/pull/19454) - Add `TiDB-Runtime` dashboard [#19396](https://github.com/pingcap/tidb/pull/19396) - - Ddl: exit add index on generated column with `case-when` expression parse error [#19395](https://github.com/pingcap/tidb/pull/19395) - - Fix issue 19371 - PREPARE statement FROM @Var (where Var contains uppercase characters fail) [#19378](https://github.com/pingcap/tidb/pull/19378) + - Make add index can exit on generated column with `case-when` expression parse error [#19395](https://github.com/pingcap/tidb/pull/19395) - Improve compatibility for ALTER TABLE algorithms [#19364](https://github.com/pingcap/tidb/pull/19364) - - Fix a schema charset modification panic bug in an uppercase schema. [#19302](https://github.com/pingcap/tidb/pull/19302) - - Planner: encode insert/delete/update plan in slow log plan field. [#19269](https://github.com/pingcap/tidb/pull/19269) - - Fix inconsistence of Plan between information_schema.statements_summary and explain, which contains tikv/tiflash info. [#19159](https://github.com/pingcap/tidb/pull/19159) + - Encode insert/delete/update plan in slow log plan field [#19269](https://github.com/pingcap/tidb/pull/19269) + TiKV From b72790cd86f68e3506409348536341dcdf01307b Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 13:55:28 +0800 Subject: [PATCH 06/32] apply overvenus' comments Signed-off-by: Ran --- releases/release-4.0.6.md | 46 ++++++++++++++++++++++++++++++++------- 1 file changed, 38 insertions(+), 8 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 4c3f30e234b39..f0af1b5611ad4 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -7,14 +7,28 @@ title: TiDB 4.0.6 Release Notes Release date: September 9, 2020 TiDB version: 4.0.6 + ## Feature ++ TiKV + + - Support to generate metafile of error codes [#8619](https://github.com/tikv/tikv/pull/8619) + - Add perf statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) + - Add perf context panel for grafana template [#8467](https://github.com/tikv/tikv/pull/8467) + + TiDB Dashboard - - Add query editor and execution UI (experimental) [#713](https://github.com/pingcap-incubator/tidb-dashboard/pull/713) - - Support store location topology visualization [#719](https://github.com/pingcap-incubator/tidb-dashboard/pull/719) - - Add cluster configuration UI (experimental) [#733](https://github.com/pingcap-incubator/tidb-dashboard/pull/733) - - Support sharing current session [#741](https://github.com/pingcap-incubator/tidb-dashboard/pull/741) - - Support displaying number of execution plans in Statement list [#746](https://github.com/pingcap-incubator/tidb-dashboard/pull/746) + + - Add query editor and execution UI (experimental) [#713](https://github.com/pingcap-incubator/tidb-dashboard/pull/713) + - Support store location topology visualization [#719](https://github.com/pingcap-incubator/tidb-dashboard/pull/719) + - Add cluster configuration UI (experimental) [#733](https://github.com/pingcap-incubator/tidb-dashboard/pull/733) + - Support sharing current session [#741](https://github.com/pingcap-incubator/tidb-dashboard/pull/741) + - Support displaying number of execution plans in Statement list [#746](https://github.com/pingcap-incubator/tidb-dashboard/pull/746) + ++ Tools + + + TiCDC + - Support output maxwell data format [#869](https://github.com/pingcap/ticdc/pull/869) + ## Improvements + TiDB @@ -29,9 +43,6 @@ TiDB version: 4.0.6 + TiKV - Optimize QPS drop when doing UnsafeDestroyRange [#8627](https://github.com/tikv/tikv/pull/8627) - - Support to generate metafile of error codes [#8619](https://github.com/tikv/tikv/pull/8619) - - Add perf statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) - - Add perf context panel for grafana template [#8467](https://github.com/tikv/tikv/pull/8467) + PD @@ -109,6 +120,25 @@ TiDB version: 4.0.6 - Fix wrong result of FROM_UNIXTIME when input is NULL [#1047](https://github.com/pingcap/tics/pull/1047) - Fix the issue that TiFlash is not available after users applied unsupported column data type modifications [#1009](https://github.com/pingcap/tics/pull/1009) ++ Tools + + + TiCDC + - Fix the issue that TiCDC leaks memory in some cases [#942](https://github.com/pingcap/ticdc/pull/942) + - Fix the issue that TiCDC may panic in Kafka sink [#912](https://github.com/pingcap/ticdc/pull/912) + - Fix the issue that CRTs may less than resolved ts in puller [#927](https://github.com/pingcap/ticdc/pull/927) + - Fix the issue that change feed may blocked by MySQL driver [#936](https://github.com/pingcap/ticdc/pull/936) + + + Backup & Restore (BR) + - Fix a panic during checksum [#479](https://github.com/pingcap/br/pull/479) + - Fix a panic after PD changes leader [#496](https://github.com/pingcap/br/pull/496) + + + Dumpling + - Fix the issue that the NULL value for binary type is not handled properly [#137](https://github.com/pingcap/dumpling/pull/137) + + + TiDB Lightning + - Fix the issue that write and ingest all retry failed will just treat it as success [#381](https://github.com/pingcap/tidb-lightning/pull/381) + - Fix the issue that some checkpoint update may not be written to db before exit [#386](https://github.com/pingcap/tidb-lightning/pull/386) + ## Bug Fix + TiDB From ddea04cf8aa4b3e82f661b26c5ea7995329b9380 Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 13:57:11 +0800 Subject: [PATCH 07/32] add tools improvement Signed-off-by: Ran --- releases/release-4.0.6.md | 21 ++++++++++++++++++++- 1 file changed, 20 insertions(+), 1 deletion(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index f0af1b5611ad4..89ab4174a5aee 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -56,6 +56,25 @@ TiDB version: 4.0.6 - Add some metrics about apply Region snapshots and ingest SST files [#1088](https://github.com/pingcap/tics/pull/1088) - Fix the problem that CN check doesn't work on https_port and metrics_port [#1064](https://github.com/pingcap/tics/pull/1064)## Bug Fixes ++ Tools + + + TiCDC + - Skip resolved lock during puller initialization [#910](https://github.com/pingcap/ticdc/pull/910) + - Reduce PD write frequency [#937](https://github.com/pingcap/ticdc/pull/937) + + + Backup & Restore (BR) + - Add real time cost in summary log [#486](https://github.com/pingcap/br/issues/486) + + + Dumpling + - Support output `INSERT` with column names [#135](https://github.com/pingcap/dumpling/pull/135) + - Unify `--filesize` and `--statement-size` definition with mydumper's [#142](https://github.com/pingcap/dumpling/pull/142) + + + TiDB Lightning + - Split and ingest region size more precise [#369](https://github.com/pingcap/tidb-lightning/pull/369) + + + TiDB Binlog + - Support go time package format gc time [#996](https://github.com/pingcap/tidb-binlog/pull/996) + ## Bug Fixes + TiDB @@ -128,7 +147,7 @@ TiDB version: 4.0.6 - Fix the issue that CRTs may less than resolved ts in puller [#927](https://github.com/pingcap/ticdc/pull/927) - Fix the issue that change feed may blocked by MySQL driver [#936](https://github.com/pingcap/ticdc/pull/936) - + Backup & Restore (BR) + + BR - Fix a panic during checksum [#479](https://github.com/pingcap/br/pull/479) - Fix a panic after PD changes leader [#496](https://github.com/pingcap/br/pull/496) From ccd3239fff3e902f45f6a477284a19f7ed1291cc Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 14:15:14 +0800 Subject: [PATCH 08/32] Update releases/release-4.0.6.md Co-authored-by: lhy1024 --- releases/release-4.0.6.md | 6 ------ 1 file changed, 6 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 89ab4174a5aee..8f164d747f92f 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -189,12 +189,6 @@ TiDB version: 4.0.6 - Fix the issue that green GC may miss locks during transferring regions. [#8460](https://github.com/tikv/tikv/pull/8460) - Support float CPU quota in cgroup. [#8427](https://github.com/tikv/tikv/pull/8427) -+ PD - - - Add `initial-cluster-token` configuration to avoid different clusters communicate during bootstrap [#2922](https://github.com/pingcap/pd/pull/2922) - - Fix the unit of store limit rate when the mode is auto [#2826](https://github.com/pingcap/pd/pull/2826) - - Fix the issue that some scheduler persist config without solving error [#2818](https://github.com/tikv/pd/pull/2818) - - fix empty http response in scheduler [#2871](https://github.com/tikv/pd/pull/2871) [#2874](https://github.com/tikv/pd/pull/2874) + TiFlash From e4372f7b07604902e2e7d5ccbe182aa993b8949b Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 14:15:34 +0800 Subject: [PATCH 09/32] Update releases/release-4.0.6.md Co-authored-by: lhy1024 --- releases/release-4.0.6.md | 5 +++++ 1 file changed, 5 insertions(+) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 8f164d747f92f..1d7d3c11043ed 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -131,7 +131,12 @@ TiDB version: 4.0.6 - Fix the deadlock between the PD client thread and other threads calling PD sync requests. [#8612](https://github.com/tikv/tikv/pull/8612) - Update jemalloc to 5.2.1 to address memory allocation problem in huge page. [#8463](https://github.com/tikv/tikv/pull/8463) - Fix unified thread pool hang for long running query. [#8427](https://github.com/tikv/tikv/pull/8427) ++ PD + - Add `initial-cluster-token` configuration to avoid different clusters communicate during bootstrap [#2922](https://github.com/pingcap/pd/pull/2922) + - Fix the unit of store limit rate when the mode is auto [#2826](https://github.com/pingcap/pd/pull/2826) + - Fix the issue that some scheduler persist config without solving error [#2818](https://github.com/tikv/pd/pull/2818) + - fix empty http response in scheduler [#2871](https://github.com/tikv/pd/pull/2871) [#2874](https://github.com/tikv/pd/pull/2874) + TiFlash - Fix the issue that TiFlash throw exceptions after modifying column nullable attribute [#1081](https://github.com/pingcap/tics/pull/1081) From 2738335007a4c120d911d43bdf3cb458c55639ed Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 14:36:45 +0800 Subject: [PATCH 10/32] remove duplicate bug fix section Signed-off-by: Ran --- releases/release-4.0.6.md | 47 +-------------------------------------- 1 file changed, 1 insertion(+), 46 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 89ab4174a5aee..dfe1cafe937c4 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -8,7 +8,7 @@ Release date: September 9, 2020 TiDB version: 4.0.6 -## Feature +## New Features + TiKV @@ -157,48 +157,3 @@ TiDB version: 4.0.6 + TiDB Lightning - Fix the issue that write and ingest all retry failed will just treat it as success [#381](https://github.com/pingcap/tidb-lightning/pull/381) - Fix the issue that some checkpoint update may not be written to db before exit [#386](https://github.com/pingcap/tidb-lightning/pull/386) - -## Bug Fix - -+ TiDB - - - Add sql digest for process list [#19829](https://github.com/pingcap/tidb/pull/19829) - - Switch to pessimistic txn mode for autocommit statement retry [#19796](https://github.com/pingcap/tidb/pull/19796) - - Support `%r`, `%T` data format in `Str_to_date()` [#19693](https://github.com/pingcap/tidb/pull/19693) - - Make `SELECT INTO OUTFILE` require the file privilege [#19577](https://github.com/pingcap/tidb/pull/19577) - - Support stddev_pop function [#19541](https://github.com/pingcap/tidb/pull/19541) - - Make DDL avoid taking too long in retry [#19488](https://github.com/pingcap/tidb/pull/19488) - - Make statements like `alter table db.t1 add constraint fk foreign key (c2) references t2(c1)` execute without first executing `use db` [#19471](https://github.com/pingcap/tidb/pull/19471) - - Fix `INFORMATION_SCHEMA.CLUSTER_HARDWARE` does not have raid devices information [#19457](https://github.com/pingcap/tidb/pull/19457) - - Make dispatch errors be changed from an Error to an Info message in the server log file [#19454](https://github.com/pingcap/tidb/pull/19454) - - Add `TiDB-Runtime` dashboard [#19396](https://github.com/pingcap/tidb/pull/19396) - - Make add index can exit on generated column with `case-when` expression parse error [#19395](https://github.com/pingcap/tidb/pull/19395) - - Improve compatibility for ALTER TABLE algorithms [#19364](https://github.com/pingcap/tidb/pull/19364) - - Encode insert/delete/update plan in slow log plan field [#19269](https://github.com/pingcap/tidb/pull/19269) - -+ TiKV - - - Optimize QPS drop when doing UnsafeDestroyRange [#8627](https://github.com/tikv/tikv/pull/8627) - - Fix the estimation error for a non-index column with collation enabled. [#8620](https://github.com/tikv/tikv/pull/8620) - - Error-code: support to generate metafile [#8619](https://github.com/tikv/tikv/pull/8619) - - Add perf statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) - - Fix the deadlock between the PD client thread and other threads calling PD sync requests. [#8612](https://github.com/tikv/tikv/pull/8612) - - Fix a panic issue if a TiKV runs very slow during conf change. [#8497](https://github.com/tikv/tikv/pull/8497) - - Add perf context panel for grafana template [#8467](https://github.com/tikv/tikv/pull/8467) - - Update jemalloc to 5.2.1 [#8463](https://github.com/tikv/tikv/pull/8463) - - Fix the issue that green GC may miss locks during transferring regions. [#8460](https://github.com/tikv/tikv/pull/8460) - - Support float CPU quota in cgroup. [#8427](https://github.com/tikv/tikv/pull/8427) - -+ PD - - - Add `initial-cluster-token` configuration to avoid different clusters communicate during bootstrap [#2922](https://github.com/pingcap/pd/pull/2922) - - Fix the unit of store limit rate when the mode is auto [#2826](https://github.com/pingcap/pd/pull/2826) - - Fix the issue that some scheduler persist config without solving error [#2818](https://github.com/tikv/pd/pull/2818) - - fix empty http response in scheduler [#2871](https://github.com/tikv/pd/pull/2871) [#2874](https://github.com/tikv/pd/pull/2874) - -+ TiFlash - - - `Do not optimize applying snapshot by multi-thread when raftstore.snap-handle-pool-size is 0` [#1086](https://github.com/pingcap/tics/pull/1086) - - `Fix bug causes segment fault while computing table sync status` [#1077](https://github.com/pingcap/tics/pull/1077) - - For invalid collation, treated as `utf8mb4_bin` in TiFlash [#1069](https://github.com/pingcap/tics/pull/1069) - - Added some Grafana panels about write stall, and added some settings to avoid write stall. [#1051](https://github.com/pingcap/tics/pull/1051) From c674827cd0b382dbb5cee7ec36231b6c71217eb5 Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 15:53:11 +0800 Subject: [PATCH 11/32] remove duplicate bug fix section Signed-off-by: Ran --- releases/release-4.0.6.md | 13 ------------- 1 file changed, 13 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index b42a309625a11..f511b834a20b9 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -183,19 +183,6 @@ TiDB version: 4.0.6 - Improve compatibility for ALTER TABLE algorithms [#19364](https://github.com/pingcap/tidb/pull/19364) - Encode insert/delete/update plan in slow log plan field [#19269](https://github.com/pingcap/tidb/pull/19269) -+ TiKV - - - Optimize QPS drop when doing UnsafeDestroyRange [#8627](https://github.com/tikv/tikv/pull/8627) - - Fix the estimation error for a non-index column with collation enabled. [#8620](https://github.com/tikv/tikv/pull/8620) - - Error-code: support to generate metafile [#8619](https://github.com/tikv/tikv/pull/8619) - - Add perf statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) - - Fix the deadlock between the PD client thread and other threads calling PD sync requests. [#8612](https://github.com/tikv/tikv/pull/8612) - - Fix a panic issue if a TiKV runs very slow during conf change. [#8497](https://github.com/tikv/tikv/pull/8497) - - Add perf context panel for grafana template [#8467](https://github.com/tikv/tikv/pull/8467) - - Update jemalloc to 5.2.1 [#8463](https://github.com/tikv/tikv/pull/8463) - - Fix the issue that green GC may miss locks during transferring regions. [#8460](https://github.com/tikv/tikv/pull/8460) - - Support float CPU quota in cgroup. [#8427](https://github.com/tikv/tikv/pull/8427) - + TiFlash - `Do not optimize applying snapshot by multi-thread when raftstore.snap-handle-pool-size is 0` [#1086](https://github.com/pingcap/tics/pull/1086) From cda15dbe98d6990aaff16e7c3b72f971cf561b2d Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 17:44:53 +0800 Subject: [PATCH 12/32] Apply suggestions from code review Co-authored-by: ruoxi --- releases/release-4.0.6.md | 4 ++++ 1 file changed, 4 insertions(+) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index f511b834a20b9..e6ef652cd8ac9 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -10,6 +10,10 @@ TiDB version: 4.0.6 ## New Features ++ TiFlash + + - Support outer join in TiFlash broadcast join [#988](https://github.com/pingcap/tics/pull/988) + + TiKV - Support to generate metafile of error codes [#8619](https://github.com/tikv/tikv/pull/8619) From 59d5517a342bd61282bd02c07d085b348df12bc0 Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 18:02:41 +0800 Subject: [PATCH 13/32] Update releases/release-4.0.6.md Co-authored-by: ruoxi --- releases/release-4.0.6.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index e6ef652cd8ac9..a86f2c51ae498 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -189,7 +189,8 @@ TiDB version: 4.0.6 + TiFlash - - `Do not optimize applying snapshot by multi-thread when raftstore.snap-handle-pool-size is 0` [#1086](https://github.com/pingcap/tics/pull/1086) - - `Fix bug causes segment fault while computing table sync status` [#1077](https://github.com/pingcap/tics/pull/1077) + - Fix bug that TiFlash coprocessor executor QPS is always 0 in Grafana [#1092](https://github.com/pingcap/tics/pull/1092) + - Do not optimize applying snapshot by multi-thread when raftstore.snap-handle-pool-size is 0 [#1086](https://github.com/pingcap/tics/pull/1086) + - Fix bug causes segment fault while computing table sync status [#1077](https://github.com/pingcap/tics/pull/1077) - For invalid collation, treated as `utf8mb4_bin` in TiFlash [#1069](https://github.com/pingcap/tics/pull/1069) - Added some Grafana panels about write stall, and added some settings to avoid write stall. [#1051](https://github.com/pingcap/tics/pull/1051) From c4947c7db63c9d1b3a75c340a810626fa23cfc57 Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 18:34:49 +0800 Subject: [PATCH 14/32] Update releases/release-4.0.6.md Co-authored-by: JaySon --- releases/release-4.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index a86f2c51ae498..72ff9370147ec 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -58,7 +58,7 @@ TiDB version: 4.0.6 + TiFlash - Add some metrics about apply Region snapshots and ingest SST files [#1088](https://github.com/pingcap/tics/pull/1088) - - Fix the problem that CN check doesn't work on https_port and metrics_port [#1064](https://github.com/pingcap/tics/pull/1064)## Bug Fixes + - Fix the problem that CN check doesn't work on https_port and metrics_port [#1064](https://github.com/pingcap/tics/pull/1064) + Tools From cef2e47b72fd779f6add93a3d5e79ea234733017 Mon Sep 17 00:00:00 2001 From: Ran Date: Fri, 11 Sep 2020 18:39:01 +0800 Subject: [PATCH 15/32] remove bug fix Signed-off-by: Ran --- releases/release-4.0.6.md | 25 ------------------------- 1 file changed, 25 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index f511b834a20b9..85b46d1c6c7b9 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -164,28 +164,3 @@ TiDB version: 4.0.6 + TiDB Lightning - Fix the issue that write and ingest all retry failed will just treat it as success [#381](https://github.com/pingcap/tidb-lightning/pull/381) - Fix the issue that some checkpoint update may not be written to db before exit [#386](https://github.com/pingcap/tidb-lightning/pull/386) - -## Bug Fix - -+ TiDB - - - Add sql digest for process list [#19829](https://github.com/pingcap/tidb/pull/19829) - - Switch to pessimistic txn mode for autocommit statement retry [#19796](https://github.com/pingcap/tidb/pull/19796) - - Support `%r`, `%T` data format in `Str_to_date()` [#19693](https://github.com/pingcap/tidb/pull/19693) - - Make `SELECT INTO OUTFILE` require the file privilege [#19577](https://github.com/pingcap/tidb/pull/19577) - - Support stddev_pop function [#19541](https://github.com/pingcap/tidb/pull/19541) - - Make DDL avoid taking too long in retry [#19488](https://github.com/pingcap/tidb/pull/19488) - - Make statements like `alter table db.t1 add constraint fk foreign key (c2) references t2(c1)` execute without first executing `use db` [#19471](https://github.com/pingcap/tidb/pull/19471) - - Fix `INFORMATION_SCHEMA.CLUSTER_HARDWARE` does not have raid devices information [#19457](https://github.com/pingcap/tidb/pull/19457) - - Make dispatch errors be changed from an Error to an Info message in the server log file [#19454](https://github.com/pingcap/tidb/pull/19454) - - Add `TiDB-Runtime` dashboard [#19396](https://github.com/pingcap/tidb/pull/19396) - - Make add index can exit on generated column with `case-when` expression parse error [#19395](https://github.com/pingcap/tidb/pull/19395) - - Improve compatibility for ALTER TABLE algorithms [#19364](https://github.com/pingcap/tidb/pull/19364) - - Encode insert/delete/update plan in slow log plan field [#19269](https://github.com/pingcap/tidb/pull/19269) - -+ TiFlash - - - `Do not optimize applying snapshot by multi-thread when raftstore.snap-handle-pool-size is 0` [#1086](https://github.com/pingcap/tics/pull/1086) - - `Fix bug causes segment fault while computing table sync status` [#1077](https://github.com/pingcap/tics/pull/1077) - - For invalid collation, treated as `utf8mb4_bin` in TiFlash [#1069](https://github.com/pingcap/tics/pull/1069) - - Added some Grafana panels about write stall, and added some settings to avoid write stall. [#1051](https://github.com/pingcap/tics/pull/1051) From 7ce202c3525cca9e06b1395c34a2e653782896cc Mon Sep 17 00:00:00 2001 From: Ran Date: Mon, 14 Sep 2020 10:23:01 +0800 Subject: [PATCH 16/32] move tikv rn Signed-off-by: Ran --- releases/release-4.0.6.md | 9 +++------ 1 file changed, 3 insertions(+), 6 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 026f01b5f5d81..158968572aadd 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -10,12 +10,6 @@ TiDB version: 4.0.6 ## New Features -+ TiKV - - - Support to generate metafile of error codes [#8619](https://github.com/tikv/tikv/pull/8619) - - Add perf statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) - - Add perf context panel for grafana template [#8467](https://github.com/tikv/tikv/pull/8467) - + TiFlash - Support outer join in TiFlash broadcast join [#988](https://github.com/pingcap/tics/pull/988) @@ -47,6 +41,9 @@ TiDB version: 4.0.6 + TiKV - Optimize QPS drop when doing UnsafeDestroyRange [#8627](https://github.com/tikv/tikv/pull/8627) + - Support to generate metafile of error codes [#8619](https://github.com/tikv/tikv/pull/8619) + - Add perf statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) + - Add perf context panel for grafana template [#8467](https://github.com/tikv/tikv/pull/8467) + PD From 59f3b43b1d63142b04a946450f5f2beac7d4268a Mon Sep 17 00:00:00 2001 From: Ran Date: Mon, 14 Sep 2020 12:52:58 +0800 Subject: [PATCH 17/32] Apply suggestions from code review Co-authored-by: Arenatlx --- releases/release-4.0.6.md | 16 ++++++++++++++-- 1 file changed, 14 insertions(+), 2 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 158968572aadd..f9caef18c85e2 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -37,7 +37,14 @@ TiDB version: 4.0.6 - Forbidden creating table in metrics_schema and performance_schema [#19792](https://github.com/pingcap/tidb/pull/19792) - Support adjust the concurrency on union executor [#19886](https://github.com/pingcap/tidb/pull/19886) - Support out join in broadcast join [#19664](https://github.com/pingcap/tidb/pull/19664) - + - Add sql digest for process list [#19829](https://github.com/pingcap/tidb/pull/19829) + - Switch to pessimistic txn mode for autocommit statement retry [#19796](https://github.com/pingcap/tidb/pull/19796) + - Support `%r`, `%T` data format in `Str_to_date()` [#19693](https://github.com/pingcap/tidb/pull/19693) + - Make `SELECT INTO OUTFILE` require the file privilege [#19577](https://github.com/pingcap/tidb/pull/19577) + - Support stddev_pop function [#19541](https://github.com/pingcap/tidb/pull/19541) + - Add `TiDB-Runtime` dashboard [#19396](https://github.com/pingcap/tidb/pull/19396) + - Improve compatibility for ALTER TABLE algorithms [#19364](https://github.com/pingcap/tidb/pull/19364) + - Encode insert/delete/update plan in slow log plan field [#19269](https://github.com/pingcap/tidb/pull/19269) + TiKV - Optimize QPS drop when doing UnsafeDestroyRange [#8627](https://github.com/tikv/tikv/pull/8627) @@ -122,7 +129,12 @@ TiDB version: 4.0.6 - Fix a bug that schema charset modification in an uppercase schema will cause panic [#19302](https://github.com/pingcap/tidb/pull/19302) - Fix a inconsistence of plan between `information_schema.statements_summary` and `explain`, which contains tikv/tiflash info [#19159](https://github.com/pingcap/tidb/pull/19159) - Fix the file exists errors in tests for `select into outfile` [#19725](https://github.com/pingcap/tidb/pull/19725) - + - Fix `INFORMATION_SCHEMA.CLUSTER_HARDWARE` does not have raid devices information [#19457](https://github.com/pingcap/tidb/pull/19457) + - Make add index can exit on generated column with `case-when` expression parse error [#19395](https://github.com/pingcap/tidb/pull/19395) + - Make DDL avoid taking too long in retry [#19488](https://github.com/pingcap/tidb/pull/19488) + - Make statements like `alter table db.t1 add constraint fk foreign key (c2) references t2(c1)` execute without first executing `use db` [#19471] + - Make dispatch errors be changed from an Error to an Info message in the server log file [#19454](https://github.com/pingcap/tidb/pull/19454) + + TiKV - Fix the estimation error for a non-index column with collation enabled. [#8620](https://github.com/tikv/tikv/pull/8620) From 3796bf55918b7563b24f8d35d8bb9ff33fe658b8 Mon Sep 17 00:00:00 2001 From: Ran Date: Mon, 14 Sep 2020 17:44:17 +0800 Subject: [PATCH 18/32] Apply suggestions from code review Co-authored-by: JaySon --- releases/release-4.0.6.md | 18 ++++++++++++------ 1 file changed, 12 insertions(+), 6 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index f9caef18c85e2..709ab498a72e8 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -61,8 +61,11 @@ TiDB version: 4.0.6 + TiFlash - - Add some metrics about apply Region snapshots and ingest SST files [#1088](https://github.com/pingcap/tics/pull/1088) - - Fix the problem that CN check doesn't work on https_port and metrics_port [#1064](https://github.com/pingcap/tics/pull/1064) + - Add Grafana panels about applying Region snapshots and ingest SST files + - Add Grafana panels about write stall + - Add `dt_segment_force_merge_delta_rows` and `dt_segment_force_merge_delta_deletes` to adjust the threshold of write stall + - Support setting `raftstore.snap-handle-pool-size` to `0` in TiFlash-Proxy to disable applying Region snapshot by multi-thread to reduce memory consumption + - Support CN check on https_port and metrics_port + Tools @@ -154,10 +157,13 @@ TiDB version: 4.0.6 + TiFlash - - Fix the issue that TiFlash throw exceptions after modifying column nullable attribute [#1081](https://github.com/pingcap/tics/pull/1081) - - Fix the issue that after renaming the primary key column in previous versions, TiFlash may not start after upgrading to v4.0.4/v4.0.5 [#1072](https://github.com/pingcap/tics/pull/1072) - - Fix wrong result of FROM_UNIXTIME when input is NULL [#1047](https://github.com/pingcap/tics/pull/1047) - - Fix the issue that TiFlash is not available after users applied unsupported column data type modifications [#1009](https://github.com/pingcap/tics/pull/1009) + - Fix the issue that after renaming the primary key column in previous versions, TiFlash may not start after upgrading to v4.0.4/v4.0.5 + - Fix the exceptions that occur after modifying the column nullable attribute + - Fix the issue that TiFlash is not available after users applied unsupported column data type modifications + - Fix the exceptions that caused by unsupported collation, treated those collation as `utf8mb4_bin` + - Fix the crash caused by computing table sync status + - Fix the issue that TiFlash coprocessor executor QPS is always 0 in Grafana + - Fix the wrong result of `FROM_UNIXTIME` when input is `NULL` + Tools From 3480c9edbd4e7f3bb5a17a62403d4997a8644498 Mon Sep 17 00:00:00 2001 From: Ran Date: Mon, 14 Sep 2020 18:26:52 +0800 Subject: [PATCH 19/32] review new features && improvements Signed-off-by: Ran --- releases/release-4.0.6.md | 67 ++++++++++++++++++++------------------- 1 file changed, 34 insertions(+), 33 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 709ab498a72e8..b9814d357c95d 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -4,7 +4,7 @@ title: TiDB 4.0.6 Release Notes # TiDB 4.0.6 Release Notes -Release date: September 9, 2020 +Release date: September 15, 2020 TiDB version: 4.0.6 @@ -12,60 +12,61 @@ TiDB version: 4.0.6 + TiFlash - - Support outer join in TiFlash broadcast join [#988](https://github.com/pingcap/tics/pull/988) + - Support outer join in TiFlash broadcast join + TiDB Dashboard - - Add query editor and execution UI (experimental) [#713](https://github.com/pingcap-incubator/tidb-dashboard/pull/713) + - Add Query Editor and execution UI (experimental) [#713](https://github.com/pingcap-incubator/tidb-dashboard/pull/713) - Support store location topology visualization [#719](https://github.com/pingcap-incubator/tidb-dashboard/pull/719) - Add cluster configuration UI (experimental) [#733](https://github.com/pingcap-incubator/tidb-dashboard/pull/733) - - Support sharing current session [#741](https://github.com/pingcap-incubator/tidb-dashboard/pull/741) - - Support displaying number of execution plans in Statement list [#746](https://github.com/pingcap-incubator/tidb-dashboard/pull/746) + - Support sharing the current session [#741](https://github.com/pingcap-incubator/tidb-dashboard/pull/741) + - Support displaying the number of execution plans in SQL Statement list [#746](https://github.com/pingcap-incubator/tidb-dashboard/pull/746) + Tools + TiCDC - - Support output maxwell data format [#869](https://github.com/pingcap/ticdc/pull/869) + - Support outputting data in the `maxwell` format [#869](https://github.com/pingcap/ticdc/pull/869) ## Improvements + TiDB - - Replace error code and message with standard error [#19888](https://github.com/pingcap/tidb/pull/19888) - - Improve the write performance of partition table [#19649](https://github.com/pingcap/tidb/pull/19649) + - Replace error codes and messages with standard errors [#19888](https://github.com/pingcap/tidb/pull/19888) + - Improve the write performance of partitioned table [#19649](https://github.com/pingcap/tidb/pull/19649) - Record more RPC runtime information in cop runtime stats [#19264](https://github.com/pingcap/tidb/pull/19264) - - Forbidden creating table in metrics_schema and performance_schema [#19792](https://github.com/pingcap/tidb/pull/19792) - - Support adjust the concurrency on union executor [#19886](https://github.com/pingcap/tidb/pull/19886) + - Forbidden creating tables in `metrics_schema` and `performance_schema` [#19792](https://github.com/pingcap/tidb/pull/19792) + - Support adjusting the concurrency of the union executor [#19886](https://github.com/pingcap/tidb/pull/19886) - Support out join in broadcast join [#19664](https://github.com/pingcap/tidb/pull/19664) - - Add sql digest for process list [#19829](https://github.com/pingcap/tidb/pull/19829) - - Switch to pessimistic txn mode for autocommit statement retry [#19796](https://github.com/pingcap/tidb/pull/19796) - - Support `%r`, `%T` data format in `Str_to_date()` [#19693](https://github.com/pingcap/tidb/pull/19693) - - Make `SELECT INTO OUTFILE` require the file privilege [#19577](https://github.com/pingcap/tidb/pull/19577) - - Support stddev_pop function [#19541](https://github.com/pingcap/tidb/pull/19541) - - Add `TiDB-Runtime` dashboard [#19396](https://github.com/pingcap/tidb/pull/19396) - - Improve compatibility for ALTER TABLE algorithms [#19364](https://github.com/pingcap/tidb/pull/19364) - - Encode insert/delete/update plan in slow log plan field [#19269](https://github.com/pingcap/tidb/pull/19269) + - Add sql digest for the process list [#19829](https://github.com/pingcap/tidb/pull/19829) + - Switch to the pessimistic transaction mode for autocommit statement retry [#19796](https://github.com/pingcap/tidb/pull/19796) + - Support the `%r` and `%T` data format in `Str_to_date()` [#19693](https://github.com/pingcap/tidb/pull/19693) + - Enable `SELECT INTO OUTFILE` to require the file privilege [#19577](https://github.com/pingcap/tidb/pull/19577) + - Support the `stddev_pop` function [#19541](https://github.com/pingcap/tidb/pull/19541) + - Add the `TiDB-Runtime` dashboard [#19396](https://github.com/pingcap/tidb/pull/19396) + - Improve compatibility for the `ALTER TABLE` algorithms [#19364](https://github.com/pingcap/tidb/pull/19364) + - Encode `insert`/`delete`/`update` plans in the slow log `plan` field [#19269](https://github.com/pingcap/tidb/pull/19269) + + TiKV - - Optimize QPS drop when doing UnsafeDestroyRange [#8627](https://github.com/tikv/tikv/pull/8627) - - Support to generate metafile of error codes [#8619](https://github.com/tikv/tikv/pull/8619) - - Add perf statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) - - Add perf context panel for grafana template [#8467](https://github.com/tikv/tikv/pull/8467) + - Reduce QPS drop when doing `UnsafeDestroyRange` [#8627](https://github.com/tikv/tikv/pull/8627) + - Support generating metafile of error codes [#8619](https://github.com/tikv/tikv/pull/8619) + - Add performance statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) + - Add the `perf context` panel in the Grafana template [#8467](https://github.com/tikv/tikv/pull/8467) + PD - - Dashboard: update to v2020.09.08.1 [#2928](https://github.com/pingcap/pd/pull/2928) - - metrics: add more metrics for region and store heartbeat [#2891](https://github.com/tikv/pd/pull/2891) + - Update TiDB Dashboard to v2020.09.08.1 [#2928](https://github.com/pingcap/pd/pull/2928) + - Add more metrics for region and store heartbeat [#2891](https://github.com/tikv/pd/pull/2891) - Change back to the original way to control the low space threshold [#2875](https://github.com/pingcap/pd/pull/2875) - - Support standard error code [#2918](https://github.com/tikv/pd/pull/2918) [#2911](https://github.com/tikv/pd/pull/2911) [#2913](https://github.com/tikv/pd/pull/2913) [#2915](https://github.com/tikv/pd/pull/2915) [#2912](https://github.com/tikv/pd/pull/2912) [#2907](https://github.com/tikv/pd/pull/2907) [#2906](https://github.com/tikv/pd/pull/2906) [#2903](https://github.com/tikv/pd/pull/2903) [#2806](https://github.com/tikv/pd/pull/2806) [#2900](https://github.com/tikv/pd/pull/2900) [#2902](https://github.com/tikv/pd/pull/2902) + - Support standard error codes [#2918](https://github.com/tikv/pd/pull/2918) [#2911](https://github.com/tikv/pd/pull/2911) [#2913](https://github.com/tikv/pd/pull/2913) [#2915](https://github.com/tikv/pd/pull/2915) [#2912](https://github.com/tikv/pd/pull/2912) [#2907](https://github.com/tikv/pd/pull/2907) [#2906](https://github.com/tikv/pd/pull/2906) [#2903](https://github.com/tikv/pd/pull/2903) [#2806](https://github.com/tikv/pd/pull/2806) [#2900](https://github.com/tikv/pd/pull/2900) [#2902](https://github.com/tikv/pd/pull/2902) + TiFlash - - Add Grafana panels about applying Region snapshots and ingest SST files + - Add Grafana panels about data replication (`apply Region snapshots` and `ingest SST files`) - Add Grafana panels about write stall - - Add `dt_segment_force_merge_delta_rows` and `dt_segment_force_merge_delta_deletes` to adjust the threshold of write stall - - Support setting `raftstore.snap-handle-pool-size` to `0` in TiFlash-Proxy to disable applying Region snapshot by multi-thread to reduce memory consumption - - Support CN check on https_port and metrics_port + - Add `dt_segment_force_merge_delta_rows` and `dt_segment_force_merge_delta_deletes` to adjust the threshold of `write stall` + - Support setting `raftstore.snap-handle-pool-size` to `0` in TiFlash-Proxy to disable applying Region snapshot by multi-thread to reduce memory consumption during data replication + - Support CN check on `https_port` and `metrics_port` + Tools @@ -78,19 +79,19 @@ TiDB version: 4.0.6 + Dumpling - Support output `INSERT` with column names [#135](https://github.com/pingcap/dumpling/pull/135) - - Unify `--filesize` and `--statement-size` definition with mydumper's [#142](https://github.com/pingcap/dumpling/pull/142) + - Unify the `--filesize` and `--statement-size` definitions with those of mydumper [#142](https://github.com/pingcap/dumpling/pull/142) + TiDB Lightning - - Split and ingest region size more precise [#369](https://github.com/pingcap/tidb-lightning/pull/369) + - Split and ingest region in more precise sizes [#369](https://github.com/pingcap/tidb-lightning/pull/369) + TiDB Binlog - - Support go time package format gc time [#996](https://github.com/pingcap/tidb-binlog/pull/996) + - Support setting GC time in `go time` package format [#996](https://github.com/pingcap/tidb-binlog/pull/996) ## Bug Fixes + TiDB - - Fix an issue of tikv_cop_wait time in metric profile [#19881](https://github.com/pingcap/tidb/pull/19881) + - Fix an issue of `tikv_cop_wait` time in metric profile [#19881](https://github.com/pingcap/tidb/pull/19881) - Fix the wrong result of `SHOW GRANTS` [#19834](https://github.com/pingcap/tidb/pull/19834) - Fix the incorrect query result for `!= ALL (subq)` [#19831](https://github.com/pingcap/tidb/pull/19831) - Fix a bug of converting enum and set [#19778](https://github.com/pingcap/tidb/pull/19778) From aa636e12c216102a06f88e410ebd16a5882c9fad Mon Sep 17 00:00:00 2001 From: Ran Date: Mon, 14 Sep 2020 21:06:29 +0800 Subject: [PATCH 20/32] review bug fixes Signed-off-by: Ran --- releases/release-4.0.6.md | 120 +++++++++++++++++++------------------- 1 file changed, 60 insertions(+), 60 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index b9814d357c95d..87ef340034456 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -93,78 +93,78 @@ TiDB version: 4.0.6 - Fix an issue of `tikv_cop_wait` time in metric profile [#19881](https://github.com/pingcap/tidb/pull/19881) - Fix the wrong result of `SHOW GRANTS` [#19834](https://github.com/pingcap/tidb/pull/19834) - - Fix the incorrect query result for `!= ALL (subq)` [#19831](https://github.com/pingcap/tidb/pull/19831) - - Fix a bug of converting enum and set [#19778](https://github.com/pingcap/tidb/pull/19778) + - Fix the incorrect query result of `!= ALL (subq)` [#19831](https://github.com/pingcap/tidb/pull/19831) + - Fix a bug of converting the `enum` and `set` types [#19778](https://github.com/pingcap/tidb/pull/19778) - Add a privilege check for `SHOW STATS_META`, `SHOW STATS_BUCKET` [#19760](https://github.com/pingcap/tidb/pull/19760) - - Fix unmatched column lengths errors caused by `builtinGreatestStringSig` and `builtinLeastStringSig` [#19758](https://github.com/pingcap/tidb/pull/19758) - - Fallback vectorize control expressions [#19749](https://github.com/pingcap/tidb/pull/19749) - - Fix errors in `Apply` when the type of correlation column is `Bit` [#19692](https://github.com/pingcap/tidb/pull/19692) - - Fix an issue of query processlist and cluster_log bug in mysql8 client [#19690](https://github.com/pingcap/tidb/pull/19690) - - Fix an issue of same type plans with different plan digest [#19684](https://github.com/pingcap/tidb/pull/19684) - - Forbidden changing `Decimal` to `Int` [#19682](https://github.com/pingcap/tidb/pull/19682) - - Fix an issue that `SELECT ... INTO OUTFILE` returns runtime error [#19672](https://github.com/pingcap/tidb/pull/19672) - - Fix an incorrect implementation in `builtinRealIsFalseSig` [#19670](https://github.com/pingcap/tidb/pull/19670) - - Fix partition expression check missing the parentheses expression [#19614](https://github.com/pingcap/tidb/pull/19614) - - Fix a query error when there is an `Apply` upon `HashJoin` [#19611](https://github.com/pingcap/tidb/pull/19611) + - Fix the error of unmatched column lengths caused by `builtinGreatestStringSig` and `builtinLeastStringSig` [#19758](https://github.com/pingcap/tidb/pull/19758) + - Fallback vectorized control expressions [#19749](https://github.com/pingcap/tidb/pull/19749) + - Fix an error of the `Apply` executor when the type of the correlation column is `Bit` [#19692](https://github.com/pingcap/tidb/pull/19692) + - Fix an issue that occurs when the user queries processlist and `cluster_log` in MySQL 8.0 client [#19690](https://github.com/pingcap/tidb/pull/19690) + - Fix an issue that plans of the same type have different plan digests [#19684](https://github.com/pingcap/tidb/pull/19684) + - Forbid changing the column type from `Decimal` to `Int` [#19682](https://github.com/pingcap/tidb/pull/19682) + - Fix an issue that `SELECT ... INTO OUTFILE` returns the runtime error [#19672](https://github.com/pingcap/tidb/pull/19672) + - Fix an incorrect implementation of `builtinRealIsFalseSig` [#19670](https://github.com/pingcap/tidb/pull/19670) + - Fix an issue that the partition expression check misses the parentheses expression [#19614](https://github.com/pingcap/tidb/pull/19614) + - Fix a query error when there is an `Apply` executor upon `HashJoin` [#19611](https://github.com/pingcap/tidb/pull/19611) - Fix an incorrect result of vectorized casting `Real` as `Time` [#19594](https://github.com/pingcap/tidb/pull/19594) - - Fix `SHOW GRANTS` can show grants for not existed user [#19588](https://github.com/pingcap/tidb/pull/19588) - - Fix a query error when there is an `Apply` upon `IndexLookupJoin` [#19566](https://github.com/pingcap/tidb/pull/19566) - - Fix wrong results when convert `Apply` to `HashJoin` on partition table [#19546](https://github.com/pingcap/tidb/pull/19546) - - Fix incorrect results when there is an `IndexLookUp` under the inner side of an `Apply` [#19508](https://github.com/pingcap/tidb/pull/19508) - - Fix a unexpected panic when using view [#19491](https://github.com/pingcap/tidb/pull/19491) + - Fix a bug that `SHOW GRANTS` shows grants for non-existent users [#19588](https://github.com/pingcap/tidb/pull/19588) + - Fix a query error when there is an `Apply` executor upon `IndexLookupJoin` [#19566](https://github.com/pingcap/tidb/pull/19566) + - Fix the wrong results when converting `Apply` to `HashJoin` on partitioned table [#19546](https://github.com/pingcap/tidb/pull/19546) + - Fix incorrect results when there is an `IndexLookUp` executor under the inner side of an `Apply` [#19508](https://github.com/pingcap/tidb/pull/19508) + - Fix an unexpected panic when using view [#19491](https://github.com/pingcap/tidb/pull/19491) - Fix an incorrect result of `anti-semi-join` query [#19477](https://github.com/pingcap/tidb/pull/19477) - - Fix dropping stats should delete topN [#19465](https://github.com/pingcap/tidb/pull/19465) + - Fix a bug that dropping statistics should delete topN [#19465](https://github.com/pingcap/tidb/pull/19465) - Fix a wrong result caused by mistaken usage of batch point get [#19460](https://github.com/pingcap/tidb/pull/19460) - - Fix a bug that it can't find column in `indexLookupJoin` with virtual generated column [#19439](https://github.com/pingcap/tidb/pull/19439) - - Fix different plans between select and update query [#19403](https://github.com/pingcap/tidb/pull/19403) - - Fix a data race for tiflash work index in region cache [#19362](https://github.com/pingcap/tidb/pull/19362) - - Fix logarithm functions [#19291](https://github.com/pingcap/tidb/pull/19291) - - Fix a unexpected error when TiDB spilling to disk [#19272](https://github.com/pingcap/tidb/pull/19272) - - Make single partition table support index join on the inner side [#19197](https://github.com/pingcap/tidb/pull/19197) - - Fix the wrong hash key for decimal [#19188](https://github.com/pingcap/tidb/pull/19188) - - Fix an issue that TiDB will raise no-regions error when table endKey and region endKey are same [#19895](https://github.com/pingcap/tidb/pull/19895) - - Fix an issue that unexpect sucess to alter partition [#19891](https://github.com/pingcap/tidb/pull/19891) - - Fix a wrong default max allowed packet for push downed expression [#19876](https://github.com/pingcap/tidb/pull/19876) - - Fix a wrong behavior for `Max/Min` on `ENUM/SET` column [#19869](https://github.com/pingcap/tidb/pull/19869) - - Fix read failure from system tables `tiflash_segments` and `tiflash_tables` when some tiflash node is down [#19748](https://github.com/pingcap/tidb/pull/19748) - - Fix a wrong result for aggregation `Count(col)` [#19628](https://github.com/pingcap/tidb/pull/19628) - - Fix a runtime error in `TRUNCATE` [#19445](https://github.com/pingcap/tidb/pull/19445) - - Fix `PREPARE` statement FROM `@Var` will fail when `Var` contains uppercase characters [#19378](https://github.com/pingcap/tidb/pull/19378) + - Fix a bug that a column cannot be found in `indexLookupJoin` with virtual generated column [#19439](https://github.com/pingcap/tidb/pull/19439) + - Fix an error that different plans of the `select` and `update` queries compare datum [#19403](https://github.com/pingcap/tidb/pull/19403) + - Fix a data race for TiFlash work index in region cache [#19362](https://github.com/pingcap/tidb/pull/19362) + - Fix a bug that the `logarithm` function does not show a warning [#19291](https://github.com/pingcap/tidb/pull/19291) + - Fix an unexpected error that occurs when TiDB persists data to disk [#19272](https://github.com/pingcap/tidb/pull/19272) + - Support using single partition table on the inner side of index join [#19197](https://github.com/pingcap/tidb/pull/19197) + - Fix the wrong hash key value generated for decimal [#19188](https://github.com/pingcap/tidb/pull/19188) + - Fix an issue that TiDB returns an `no regions` error when table endKey and region endKey are the same [#19895](https://github.com/pingcap/tidb/pull/19895) + - Fix the unexpected success of alter partition [#19891](https://github.com/pingcap/tidb/pull/19891) + - Fix the wrong value of the default maximum packet length allowed for pushed down expression [#19876](https://github.com/pingcap/tidb/pull/19876) + - Fix a wrong behavior for the `Max`/`Min` functions on the `ENUM`/`SET` columns [#19869](https://github.com/pingcap/tidb/pull/19869) + - Fix read failure from the `tiflash_segments` and `tiflash_tables` system tables when some TiFlash nodes are offline [#19748](https://github.com/pingcap/tidb/pull/19748) + - Fix a wrong result of the `Count(col)` aggregation function [#19628](https://github.com/pingcap/tidb/pull/19628) + - Fix a runtime error of the `TRUNCATE` operation [#19445](https://github.com/pingcap/tidb/pull/19445) + - Fix the issue that `PREPARE statement FROM @Var` will fail when `Var` contains uppercase characters [#19378](https://github.com/pingcap/tidb/pull/19378) - Fix a bug that schema charset modification in an uppercase schema will cause panic [#19302](https://github.com/pingcap/tidb/pull/19302) - - Fix a inconsistence of plan between `information_schema.statements_summary` and `explain`, which contains tikv/tiflash info [#19159](https://github.com/pingcap/tidb/pull/19159) - - Fix the file exists errors in tests for `select into outfile` [#19725](https://github.com/pingcap/tidb/pull/19725) - - Fix `INFORMATION_SCHEMA.CLUSTER_HARDWARE` does not have raid devices information [#19457](https://github.com/pingcap/tidb/pull/19457) - - Make add index can exit on generated column with `case-when` expression parse error [#19395](https://github.com/pingcap/tidb/pull/19395) - - Make DDL avoid taking too long in retry [#19488](https://github.com/pingcap/tidb/pull/19488) - - Make statements like `alter table db.t1 add constraint fk foreign key (c2) references t2(c1)` execute without first executing `use db` [#19471] - - Make dispatch errors be changed from an Error to an Info message in the server log file [#19454](https://github.com/pingcap/tidb/pull/19454) - + - Fix inconsistency between `information_schema.statements_summary` and `explain` plan, when the information contains `tikv/tiflash` [#19159](https://github.com/pingcap/tidb/pull/19159) + - Fix the error in tests that the file does not exist for `select into outfile` [#19725](https://github.com/pingcap/tidb/pull/19725) + - Fix the issue that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` does not have raid device information [#19457](https://github.com/pingcap/tidb/pull/19457) + - Make the `add index` operation that has a generated column with the `case-when` expression can exit normally when it encounters a parse error [#19395](https://github.com/pingcap/tidb/pull/19395) + - Fix a bug that DDL takes too long to retry [#19488](https://github.com/pingcap/tidb/pull/19488) + - Make statements like `alter table db.t1 add constraint fk foreign key (c2) references t2(c1)` execute without first executing `use db` [#19471](https://github.com/pingcap/tidb/pull/19471) + - Change the dispatch error from an Error to an Info message in the server log file [#19454](https://github.com/pingcap/tidb/pull/19454) + + TiKV - - Fix the estimation error for a non-index column with collation enabled. [#8620](https://github.com/tikv/tikv/pull/8620) - - Fix the issue that green GC may miss locks during transferring regions. [#8460](https://github.com/tikv/tikv/pull/8460) - - Fix the CDC incorrect resolved TS timeout. [#8573](https://github.com/tikv/tikv/pull/8573) - - Fix a panic issue if a TiKV runs very slow during conf change. [#8497](https://github.com/tikv/tikv/pull/8497) - - Fix the deadlock between the PD client thread and other threads calling PD sync requests. [#8612](https://github.com/tikv/tikv/pull/8612) - - Update jemalloc to 5.2.1 to address memory allocation problem in huge page. [#8463](https://github.com/tikv/tikv/pull/8463) + - Fix the estimation error for a non-index column when collation is enabled [#8620](https://github.com/tikv/tikv/pull/8620) + - Fix the issue that green GC might miss locks during Region transfer [#8460](https://github.com/tikv/tikv/pull/8460) + - Fix the CDC incorrect resolved TS timeout [#8573](https://github.com/tikv/tikv/pull/8573) + - Fix a panic issue if a TiKV runs very slow during conf change [#8497](https://github.com/tikv/tikv/pull/8497) + - Fix the deadlock issue between the PD client thread and other threads calling PD sync requests [#8612](https://github.com/tikv/tikv/pull/8612) + - Update jemalloc to 5.2.1 to address memory allocation problem in huge page [#8463](https://github.com/tikv/tikv/pull/8463) - Fix unified thread pool hang for long running query. [#8427](https://github.com/tikv/tikv/pull/8427) + PD - - Add `initial-cluster-token` configuration to avoid different clusters communicate during bootstrap [#2922](https://github.com/pingcap/pd/pull/2922) - - Fix the unit of store limit rate when the mode is auto [#2826](https://github.com/pingcap/pd/pull/2826) + - Add the `initial-cluster-token` configuration to prevent different clusters from communicating to each other during bootstrap [#2922](https://github.com/pingcap/pd/pull/2922) + - Fix the unit of store limit rate when the mode is `auto` [#2826](https://github.com/pingcap/pd/pull/2826) - Fix the issue that some scheduler persist config without solving error [#2818](https://github.com/tikv/pd/pull/2818) - - fix empty http response in scheduler [#2871](https://github.com/tikv/pd/pull/2871) [#2874](https://github.com/tikv/pd/pull/2874) + - Fix empty http response in scheduler [#2871](https://github.com/tikv/pd/pull/2871) [#2874](https://github.com/tikv/pd/pull/2874) + TiFlash - - Fix the issue that after renaming the primary key column in previous versions, TiFlash may not start after upgrading to v4.0.4/v4.0.5 - - Fix the exceptions that occur after modifying the column nullable attribute - - Fix the issue that TiFlash is not available after users applied unsupported column data type modifications - - Fix the exceptions that caused by unsupported collation, treated those collation as `utf8mb4_bin` + - Fix the issue that after renaming the primary key column in previous versions, TiFlash might not start after upgrading to v4.0.4/v4.0.5 + - Fix the exceptions that occur after modifying the column's `nullable` attribute - Fix the crash caused by computing table sync status + - Fix the issue that TiFlash is not available after users applied unsupported column data type modifications + - Fix the exceptions caused by unsupported collations, treated those collation as `utf8mb4_bin` - Fix the issue that TiFlash coprocessor executor QPS is always 0 in Grafana - - Fix the wrong result of `FROM_UNIXTIME` when input is `NULL` + - Fix the wrong result of the `FROM_UNIXTIME` function when input is `NULL` + Tools @@ -172,15 +172,15 @@ TiDB version: 4.0.6 - Fix the issue that TiCDC leaks memory in some cases [#942](https://github.com/pingcap/ticdc/pull/942) - Fix the issue that TiCDC may panic in Kafka sink [#912](https://github.com/pingcap/ticdc/pull/912) - Fix the issue that CRTs may less than resolved ts in puller [#927](https://github.com/pingcap/ticdc/pull/927) - - Fix the issue that change feed may blocked by MySQL driver [#936](https://github.com/pingcap/ticdc/pull/936) + - Fix the issue that change feed may be blocked by MySQL driver [#936](https://github.com/pingcap/ticdc/pull/936) + BR - - Fix a panic during checksum [#479](https://github.com/pingcap/br/pull/479) - - Fix a panic after PD changes leader [#496](https://github.com/pingcap/br/pull/496) + - Fix a panic that occurs during checksum [#479](https://github.com/pingcap/br/pull/479) + - Fix a panic that occurs after PD changes leader [#496](https://github.com/pingcap/br/pull/496) + Dumpling - - Fix the issue that the NULL value for binary type is not handled properly [#137](https://github.com/pingcap/dumpling/pull/137) + - Fix the issue that the `NULL` value for binary type is not handled properly [#137](https://github.com/pingcap/dumpling/pull/137) + TiDB Lightning - Fix the issue that write and ingest all retry failed will just treat it as success [#381](https://github.com/pingcap/tidb-lightning/pull/381) - - Fix the issue that some checkpoint update may not be written to db before exit [#386](https://github.com/pingcap/tidb-lightning/pull/386) + - Fix the issue that some checkpoint updates may not be written to db before exit [#386](https://github.com/pingcap/tidb-lightning/pull/386) From 66a5b843532d106710b3c72f76ed61e373c666f6 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 15 Sep 2020 10:26:22 +0800 Subject: [PATCH 21/32] Apply suggestions from code review --- releases/release-4.0.6.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 87ef340034456..cded0d5ee9459 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -34,10 +34,10 @@ TiDB version: 4.0.6 - Replace error codes and messages with standard errors [#19888](https://github.com/pingcap/tidb/pull/19888) - Improve the write performance of partitioned table [#19649](https://github.com/pingcap/tidb/pull/19649) - Record more RPC runtime information in cop runtime stats [#19264](https://github.com/pingcap/tidb/pull/19264) - - Forbidden creating tables in `metrics_schema` and `performance_schema` [#19792](https://github.com/pingcap/tidb/pull/19792) + - Forbid creating tables in `metrics_schema` and `performance_schema` [#19792](https://github.com/pingcap/tidb/pull/19792) - Support adjusting the concurrency of the union executor [#19886](https://github.com/pingcap/tidb/pull/19886) - Support out join in broadcast join [#19664](https://github.com/pingcap/tidb/pull/19664) - - Add sql digest for the process list [#19829](https://github.com/pingcap/tidb/pull/19829) + - Add SQL digest for the process list [#19829](https://github.com/pingcap/tidb/pull/19829) - Switch to the pessimistic transaction mode for autocommit statement retry [#19796](https://github.com/pingcap/tidb/pull/19796) - Support the `%r` and `%T` data format in `Str_to_date()` [#19693](https://github.com/pingcap/tidb/pull/19693) - Enable `SELECT INTO OUTFILE` to require the file privilege [#19577](https://github.com/pingcap/tidb/pull/19577) @@ -56,7 +56,7 @@ TiDB version: 4.0.6 + PD - Update TiDB Dashboard to v2020.09.08.1 [#2928](https://github.com/pingcap/pd/pull/2928) - - Add more metrics for region and store heartbeat [#2891](https://github.com/tikv/pd/pull/2891) + - Add more metrics for Region and store heartbeat [#2891](https://github.com/tikv/pd/pull/2891) - Change back to the original way to control the low space threshold [#2875](https://github.com/pingcap/pd/pull/2875) - Support standard error codes [#2918](https://github.com/tikv/pd/pull/2918) [#2911](https://github.com/tikv/pd/pull/2911) [#2913](https://github.com/tikv/pd/pull/2913) [#2915](https://github.com/tikv/pd/pull/2915) [#2912](https://github.com/tikv/pd/pull/2912) [#2907](https://github.com/tikv/pd/pull/2907) [#2906](https://github.com/tikv/pd/pull/2906) [#2903](https://github.com/tikv/pd/pull/2903) [#2806](https://github.com/tikv/pd/pull/2806) [#2900](https://github.com/tikv/pd/pull/2900) [#2902](https://github.com/tikv/pd/pull/2902) @@ -78,11 +78,11 @@ TiDB version: 4.0.6 - Add real time cost in summary log [#486](https://github.com/pingcap/br/issues/486) + Dumpling - - Support output `INSERT` with column names [#135](https://github.com/pingcap/dumpling/pull/135) + - Support outputting `INSERT` with column names [#135](https://github.com/pingcap/dumpling/pull/135) - Unify the `--filesize` and `--statement-size` definitions with those of mydumper [#142](https://github.com/pingcap/dumpling/pull/142) + TiDB Lightning - - Split and ingest region in more precise sizes [#369](https://github.com/pingcap/tidb-lightning/pull/369) + - Split and ingest Region in more precise sizes [#369](https://github.com/pingcap/tidb-lightning/pull/369) + TiDB Binlog - Support setting GC time in `go time` package format [#996](https://github.com/pingcap/tidb-binlog/pull/996) @@ -120,7 +120,7 @@ TiDB version: 4.0.6 - Fix a data race for TiFlash work index in region cache [#19362](https://github.com/pingcap/tidb/pull/19362) - Fix a bug that the `logarithm` function does not show a warning [#19291](https://github.com/pingcap/tidb/pull/19291) - Fix an unexpected error that occurs when TiDB persists data to disk [#19272](https://github.com/pingcap/tidb/pull/19272) - - Support using single partition table on the inner side of index join [#19197](https://github.com/pingcap/tidb/pull/19197) + - Support using single partitioned table on the inner side of index join [#19197](https://github.com/pingcap/tidb/pull/19197) - Fix the wrong hash key value generated for decimal [#19188](https://github.com/pingcap/tidb/pull/19188) - Fix an issue that TiDB returns an `no regions` error when table endKey and region endKey are the same [#19895](https://github.com/pingcap/tidb/pull/19895) - Fix the unexpected success of alter partition [#19891](https://github.com/pingcap/tidb/pull/19891) @@ -174,7 +174,7 @@ TiDB version: 4.0.6 - Fix the issue that CRTs may less than resolved ts in puller [#927](https://github.com/pingcap/ticdc/pull/927) - Fix the issue that change feed may be blocked by MySQL driver [#936](https://github.com/pingcap/ticdc/pull/936) - + BR + + Backup & Restore (BR) - Fix a panic that occurs during checksum [#479](https://github.com/pingcap/br/pull/479) - Fix a panic that occurs after PD changes leader [#496](https://github.com/pingcap/br/pull/496) From 652d2e6525e379ed0da05ea9c90f41d9ebcb48c4 Mon Sep 17 00:00:00 2001 From: TomShawn <41534398+TomShawn@users.noreply.github.com> Date: Tue, 15 Sep 2020 11:52:49 +0800 Subject: [PATCH 22/32] refine format --- releases/release-4.0.6.md | 10 ++++++++++ 1 file changed, 10 insertions(+) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index cded0d5ee9459..4ddb618f97be7 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -25,6 +25,7 @@ TiDB version: 4.0.6 + Tools + TiCDC + - Support outputting data in the `maxwell` format [#869](https://github.com/pingcap/ticdc/pull/869) ## Improvements @@ -71,20 +72,25 @@ TiDB version: 4.0.6 + Tools + TiCDC + - Skip resolved lock during puller initialization [#910](https://github.com/pingcap/ticdc/pull/910) - Reduce PD write frequency [#937](https://github.com/pingcap/ticdc/pull/937) + Backup & Restore (BR) + - Add real time cost in summary log [#486](https://github.com/pingcap/br/issues/486) + Dumpling + - Support outputting `INSERT` with column names [#135](https://github.com/pingcap/dumpling/pull/135) - Unify the `--filesize` and `--statement-size` definitions with those of mydumper [#142](https://github.com/pingcap/dumpling/pull/142) + TiDB Lightning + - Split and ingest Region in more precise sizes [#369](https://github.com/pingcap/tidb-lightning/pull/369) + TiDB Binlog + - Support setting GC time in `go time` package format [#996](https://github.com/pingcap/tidb-binlog/pull/996) ## Bug Fixes @@ -169,18 +175,22 @@ TiDB version: 4.0.6 + Tools + TiCDC + - Fix the issue that TiCDC leaks memory in some cases [#942](https://github.com/pingcap/ticdc/pull/942) - Fix the issue that TiCDC may panic in Kafka sink [#912](https://github.com/pingcap/ticdc/pull/912) - Fix the issue that CRTs may less than resolved ts in puller [#927](https://github.com/pingcap/ticdc/pull/927) - Fix the issue that change feed may be blocked by MySQL driver [#936](https://github.com/pingcap/ticdc/pull/936) + Backup & Restore (BR) + - Fix a panic that occurs during checksum [#479](https://github.com/pingcap/br/pull/479) - Fix a panic that occurs after PD changes leader [#496](https://github.com/pingcap/br/pull/496) + Dumpling + - Fix the issue that the `NULL` value for binary type is not handled properly [#137](https://github.com/pingcap/dumpling/pull/137) + TiDB Lightning + - Fix the issue that write and ingest all retry failed will just treat it as success [#381](https://github.com/pingcap/tidb-lightning/pull/381) - Fix the issue that some checkpoint updates may not be written to db before exit [#386](https://github.com/pingcap/tidb-lightning/pull/386) From 6851740d7540469722c944475e31efc648f642ee Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 15 Sep 2020 13:12:52 +0800 Subject: [PATCH 23/32] Apply suggestions from code review Co-authored-by: TomShawn <41534398+TomShawn@users.noreply.github.com> --- releases/release-4.0.6.md | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 4ddb618f97be7..252bdff63fd7c 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -52,7 +52,7 @@ TiDB version: 4.0.6 - Reduce QPS drop when doing `UnsafeDestroyRange` [#8627](https://github.com/tikv/tikv/pull/8627) - Support generating metafile of error codes [#8619](https://github.com/tikv/tikv/pull/8619) - Add performance statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) - - Add the `perf context` panel in the Grafana template [#8467](https://github.com/tikv/tikv/pull/8467) + - Add the `rocksdb perf context` panel in the Grafana default template [#8467](https://github.com/tikv/tikv/pull/8467) + PD @@ -63,8 +63,8 @@ TiDB version: 4.0.6 + TiFlash - - Add Grafana panels about data replication (`apply Region snapshots` and `ingest SST files`) - - Add Grafana panels about write stall + - Add Grafana panels for data replication (`apply Region snapshots` and `ingest SST files`) + - Add Grafana panels for write stall - Add `dt_segment_force_merge_delta_rows` and `dt_segment_force_merge_delta_deletes` to adjust the threshold of `write stall` - Support setting `raftstore.snap-handle-pool-size` to `0` in TiFlash-Proxy to disable applying Region snapshot by multi-thread to reduce memory consumption during data replication - Support CN check on `https_port` and `metrics_port` @@ -101,19 +101,19 @@ TiDB version: 4.0.6 - Fix the wrong result of `SHOW GRANTS` [#19834](https://github.com/pingcap/tidb/pull/19834) - Fix the incorrect query result of `!= ALL (subq)` [#19831](https://github.com/pingcap/tidb/pull/19831) - Fix a bug of converting the `enum` and `set` types [#19778](https://github.com/pingcap/tidb/pull/19778) - - Add a privilege check for `SHOW STATS_META`, `SHOW STATS_BUCKET` [#19760](https://github.com/pingcap/tidb/pull/19760) + - Add a privilege check for `SHOW STATS_META` and `SHOW STATS_BUCKET` [#19760](https://github.com/pingcap/tidb/pull/19760) - Fix the error of unmatched column lengths caused by `builtinGreatestStringSig` and `builtinLeastStringSig` [#19758](https://github.com/pingcap/tidb/pull/19758) - Fallback vectorized control expressions [#19749](https://github.com/pingcap/tidb/pull/19749) - Fix an error of the `Apply` executor when the type of the correlation column is `Bit` [#19692](https://github.com/pingcap/tidb/pull/19692) - - Fix an issue that occurs when the user queries processlist and `cluster_log` in MySQL 8.0 client [#19690](https://github.com/pingcap/tidb/pull/19690) + - Fix an issue that occurs when the user queries `processlist` and `cluster_log` in MySQL 8.0 client [#19690](https://github.com/pingcap/tidb/pull/19690) - Fix an issue that plans of the same type have different plan digests [#19684](https://github.com/pingcap/tidb/pull/19684) - Forbid changing the column type from `Decimal` to `Int` [#19682](https://github.com/pingcap/tidb/pull/19682) - Fix an issue that `SELECT ... INTO OUTFILE` returns the runtime error [#19672](https://github.com/pingcap/tidb/pull/19672) - Fix an incorrect implementation of `builtinRealIsFalseSig` [#19670](https://github.com/pingcap/tidb/pull/19670) - Fix an issue that the partition expression check misses the parentheses expression [#19614](https://github.com/pingcap/tidb/pull/19614) - Fix a query error when there is an `Apply` executor upon `HashJoin` [#19611](https://github.com/pingcap/tidb/pull/19611) - - Fix an incorrect result of vectorized casting `Real` as `Time` [#19594](https://github.com/pingcap/tidb/pull/19594) - - Fix a bug that `SHOW GRANTS` shows grants for non-existent users [#19588](https://github.com/pingcap/tidb/pull/19588) + - Fix an incorrect result of vectorization that casts `Real` as `Time` [#19594](https://github.com/pingcap/tidb/pull/19594) + - Fix a bug that the `SHOW GRANTS` statement shows grants for non-existent users [#19588](https://github.com/pingcap/tidb/pull/19588) - Fix a query error when there is an `Apply` executor upon `IndexLookupJoin` [#19566](https://github.com/pingcap/tidb/pull/19566) - Fix the wrong results when converting `Apply` to `HashJoin` on partitioned table [#19546](https://github.com/pingcap/tidb/pull/19546) - Fix incorrect results when there is an `IndexLookUp` executor under the inner side of an `Apply` [#19508](https://github.com/pingcap/tidb/pull/19508) From c306e1210673d62634181b829994818fb4d4cda1 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 15 Sep 2020 13:23:45 +0800 Subject: [PATCH 24/32] Apply suggestions from code review --- releases/release-4.0.6.md | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 252bdff63fd7c..70b7066e5ca11 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -115,18 +115,18 @@ TiDB version: 4.0.6 - Fix an incorrect result of vectorization that casts `Real` as `Time` [#19594](https://github.com/pingcap/tidb/pull/19594) - Fix a bug that the `SHOW GRANTS` statement shows grants for non-existent users [#19588](https://github.com/pingcap/tidb/pull/19588) - Fix a query error when there is an `Apply` executor upon `IndexLookupJoin` [#19566](https://github.com/pingcap/tidb/pull/19566) - - Fix the wrong results when converting `Apply` to `HashJoin` on partitioned table [#19546](https://github.com/pingcap/tidb/pull/19546) + - Fix the wrong results when converting `Apply` to `HashJoin` on a partitioned table [#19546](https://github.com/pingcap/tidb/pull/19546) - Fix incorrect results when there is an `IndexLookUp` executor under the inner side of an `Apply` [#19508](https://github.com/pingcap/tidb/pull/19508) - Fix an unexpected panic when using view [#19491](https://github.com/pingcap/tidb/pull/19491) - Fix an incorrect result of `anti-semi-join` query [#19477](https://github.com/pingcap/tidb/pull/19477) - - Fix a bug that dropping statistics should delete topN [#19465](https://github.com/pingcap/tidb/pull/19465) + - Fix a bug that topN statistics is not deleted when the statistics is dropped [#19465](https://github.com/pingcap/tidb/pull/19465) - Fix a wrong result caused by mistaken usage of batch point get [#19460](https://github.com/pingcap/tidb/pull/19460) - - Fix a bug that a column cannot be found in `indexLookupJoin` with virtual generated column [#19439](https://github.com/pingcap/tidb/pull/19439) + - Fix a bug that a column cannot be found in `indexLookupJoin` with a virtual generated column [#19439](https://github.com/pingcap/tidb/pull/19439) - Fix an error that different plans of the `select` and `update` queries compare datum [#19403](https://github.com/pingcap/tidb/pull/19403) - Fix a data race for TiFlash work index in region cache [#19362](https://github.com/pingcap/tidb/pull/19362) - Fix a bug that the `logarithm` function does not show a warning [#19291](https://github.com/pingcap/tidb/pull/19291) - Fix an unexpected error that occurs when TiDB persists data to disk [#19272](https://github.com/pingcap/tidb/pull/19272) - - Support using single partitioned table on the inner side of index join [#19197](https://github.com/pingcap/tidb/pull/19197) + - Support using a single partitioned table on the inner side of index join [#19197](https://github.com/pingcap/tidb/pull/19197) - Fix the wrong hash key value generated for decimal [#19188](https://github.com/pingcap/tidb/pull/19188) - Fix an issue that TiDB returns an `no regions` error when table endKey and region endKey are the same [#19895](https://github.com/pingcap/tidb/pull/19895) - Fix the unexpected success of alter partition [#19891](https://github.com/pingcap/tidb/pull/19891) From 66d82afba11c4e2cb2fd0141361f2fd47ca95359 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 15 Sep 2020 13:35:39 +0800 Subject: [PATCH 25/32] Apply suggestions from code review --- releases/release-4.0.6.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 70b7066e5ca11..aa3a5ef08801e 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -130,14 +130,14 @@ TiDB version: 4.0.6 - Fix the wrong hash key value generated for decimal [#19188](https://github.com/pingcap/tidb/pull/19188) - Fix an issue that TiDB returns an `no regions` error when table endKey and region endKey are the same [#19895](https://github.com/pingcap/tidb/pull/19895) - Fix the unexpected success of alter partition [#19891](https://github.com/pingcap/tidb/pull/19891) - - Fix the wrong value of the default maximum packet length allowed for pushed down expression [#19876](https://github.com/pingcap/tidb/pull/19876) + - Fix the wrong value of the default maximum packet length allowed for pushed down expressions [#19876](https://github.com/pingcap/tidb/pull/19876) - Fix a wrong behavior for the `Max`/`Min` functions on the `ENUM`/`SET` columns [#19869](https://github.com/pingcap/tidb/pull/19869) - Fix read failure from the `tiflash_segments` and `tiflash_tables` system tables when some TiFlash nodes are offline [#19748](https://github.com/pingcap/tidb/pull/19748) - Fix a wrong result of the `Count(col)` aggregation function [#19628](https://github.com/pingcap/tidb/pull/19628) - Fix a runtime error of the `TRUNCATE` operation [#19445](https://github.com/pingcap/tidb/pull/19445) - Fix the issue that `PREPARE statement FROM @Var` will fail when `Var` contains uppercase characters [#19378](https://github.com/pingcap/tidb/pull/19378) - Fix a bug that schema charset modification in an uppercase schema will cause panic [#19302](https://github.com/pingcap/tidb/pull/19302) - - Fix inconsistency between `information_schema.statements_summary` and `explain` plan, when the information contains `tikv/tiflash` [#19159](https://github.com/pingcap/tidb/pull/19159) + - Fix inconsistency of plans between `information_schema.statements_summary` and `explain`, when the information contains `tikv/tiflash` [#19159](https://github.com/pingcap/tidb/pull/19159) - Fix the error in tests that the file does not exist for `select into outfile` [#19725](https://github.com/pingcap/tidb/pull/19725) - Fix the issue that `INFORMATION_SCHEMA.CLUSTER_HARDWARE` does not have raid device information [#19457](https://github.com/pingcap/tidb/pull/19457) - Make the `add index` operation that has a generated column with the `case-when` expression can exit normally when it encounters a parse error [#19395](https://github.com/pingcap/tidb/pull/19395) From 548fc2d191c607fb7c03faa6dcf759c0d1aa0fa0 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 15 Sep 2020 13:56:59 +0800 Subject: [PATCH 26/32] Apply suggestions from code review Co-authored-by: TomShawn <41534398+TomShawn@users.noreply.github.com> --- releases/release-4.0.6.md | 38 +++++++++++++++++++------------------- 1 file changed, 19 insertions(+), 19 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index aa3a5ef08801e..36033df0e221e 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -148,28 +148,28 @@ TiDB version: 4.0.6 + TiKV - Fix the estimation error for a non-index column when collation is enabled [#8620](https://github.com/tikv/tikv/pull/8620) - - Fix the issue that green GC might miss locks during Region transfer [#8460](https://github.com/tikv/tikv/pull/8460) + - Fix the issue that Green GC might miss locks during the process of Region transfer [#8460](https://github.com/tikv/tikv/pull/8460) - Fix the CDC incorrect resolved TS timeout [#8573](https://github.com/tikv/tikv/pull/8573) - - Fix a panic issue if a TiKV runs very slow during conf change [#8497](https://github.com/tikv/tikv/pull/8497) - - Fix the deadlock issue between the PD client thread and other threads calling PD sync requests [#8612](https://github.com/tikv/tikv/pull/8612) - - Update jemalloc to 5.2.1 to address memory allocation problem in huge page [#8463](https://github.com/tikv/tikv/pull/8463) - - Fix unified thread pool hang for long running query. [#8427](https://github.com/tikv/tikv/pull/8427) + - Fix a panic issue that occurs when TiKV runs very slowly during configuration change [#8497](https://github.com/tikv/tikv/pull/8497) + - Fix the deadlock issue that occurs between the PD client thread and other threads when calling PD sync requests [#8612](https://github.com/tikv/tikv/pull/8612) + - Upgrade jemalloc to v5.2.1 to address the issue of memory allocation in huge page [#8463](https://github.com/tikv/tikv/pull/8463) + - Fix the issue that the unified thread pool hangs for long-running queries [#8427](https://github.com/tikv/tikv/pull/8427) + PD - - Add the `initial-cluster-token` configuration to prevent different clusters from communicating to each other during bootstrap [#2922](https://github.com/pingcap/pd/pull/2922) + - Add the `initial-cluster-token` configuration to prevent different clusters from communicating with each other during bootstrap [#2922](https://github.com/pingcap/pd/pull/2922) - Fix the unit of store limit rate when the mode is `auto` [#2826](https://github.com/pingcap/pd/pull/2826) - - Fix the issue that some scheduler persist config without solving error [#2818](https://github.com/tikv/pd/pull/2818) - - Fix empty http response in scheduler [#2871](https://github.com/tikv/pd/pull/2871) [#2874](https://github.com/tikv/pd/pull/2874) + - Fix the issue that some schedulers persist configuration without solving errors [#2818](https://github.com/tikv/pd/pull/2818) + - Fix the empty HTTP response in scheduler [#2871](https://github.com/tikv/pd/pull/2871) [#2874](https://github.com/tikv/pd/pull/2874) + TiFlash - Fix the issue that after renaming the primary key column in previous versions, TiFlash might not start after upgrading to v4.0.4/v4.0.5 - Fix the exceptions that occur after modifying the column's `nullable` attribute - - Fix the crash caused by computing table sync status - - Fix the issue that TiFlash is not available after users applied unsupported column data type modifications - - Fix the exceptions caused by unsupported collations, treated those collation as `utf8mb4_bin` - - Fix the issue that TiFlash coprocessor executor QPS is always 0 in Grafana + - Fix the crash caused by computing a table's replication status + - Fix the issue that TiFlash is not available for data reads after users applied unsupported DDL operations + - Fix the exceptions caused by unsupported collations which are treated as `utf8mb4_bin` + - Fix the issue that the QPS panel for the TiFlash coprocessor executor always displays `0` in Grafana - Fix the wrong result of the `FROM_UNIXTIME` function when input is `NULL` + Tools @@ -177,20 +177,20 @@ TiDB version: 4.0.6 + TiCDC - Fix the issue that TiCDC leaks memory in some cases [#942](https://github.com/pingcap/ticdc/pull/942) - - Fix the issue that TiCDC may panic in Kafka sink [#912](https://github.com/pingcap/ticdc/pull/912) + - Fix the issue that TiCDC might panic in Kafka sink [#912](https://github.com/pingcap/ticdc/pull/912) - Fix the issue that CRTs may less than resolved ts in puller [#927](https://github.com/pingcap/ticdc/pull/927) - - Fix the issue that change feed may be blocked by MySQL driver [#936](https://github.com/pingcap/ticdc/pull/936) + - Fix the issue that `changefeed` might be blocked by MySQL driver [#936](https://github.com/pingcap/ticdc/pull/936) + Backup & Restore (BR) - - Fix a panic that occurs during checksum [#479](https://github.com/pingcap/br/pull/479) - - Fix a panic that occurs after PD changes leader [#496](https://github.com/pingcap/br/pull/496) + - Fix a panic that might occur during checksum [#479](https://github.com/pingcap/br/pull/479) + - Fix a panic that might occur after the change of PD leader [#496](https://github.com/pingcap/br/pull/496) + Dumpling - - Fix the issue that the `NULL` value for binary type is not handled properly [#137](https://github.com/pingcap/dumpling/pull/137) + - Fix the issue that the `NULL` value for the binary type is not handled properly [#137](https://github.com/pingcap/dumpling/pull/137) + TiDB Lightning - - Fix the issue that write and ingest all retry failed will just treat it as success [#381](https://github.com/pingcap/tidb-lightning/pull/381) - - Fix the issue that some checkpoint updates may not be written to db before exit [#386](https://github.com/pingcap/tidb-lightning/pull/386) + - Fix the issue that all failed operations of writes and ingests are mistakenly displayed as successful [#381](https://github.com/pingcap/tidb-lightning/pull/381) + - Fix the issue that some checkpoint updates might not be written to the database before TiDB Lightning exits [#386](https://github.com/pingcap/tidb-lightning/pull/386) From 21edd86bd0d26ab66922ff28f8d59e0ade15c2a6 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 15 Sep 2020 14:15:23 +0800 Subject: [PATCH 27/32] Apply suggestions from code review Co-authored-by: TomShawn <41534398+TomShawn@users.noreply.github.com> --- releases/release-4.0.6.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 36033df0e221e..55b6d9c036f60 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -49,7 +49,7 @@ TiDB version: 4.0.6 + TiKV - - Reduce QPS drop when doing `UnsafeDestroyRange` [#8627](https://github.com/tikv/tikv/pull/8627) + - Reduce QPS drop when `DropTable` or `TruncateTable` is being executed [#8627](https://github.com/tikv/tikv/pull/8627) - Support generating metafile of error codes [#8619](https://github.com/tikv/tikv/pull/8619) - Add performance statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) - Add the `rocksdb perf context` panel in the Grafana default template [#8467](https://github.com/tikv/tikv/pull/8467) @@ -178,8 +178,9 @@ TiDB version: 4.0.6 - Fix the issue that TiCDC leaks memory in some cases [#942](https://github.com/pingcap/ticdc/pull/942) - Fix the issue that TiCDC might panic in Kafka sink [#912](https://github.com/pingcap/ticdc/pull/912) - - Fix the issue that CRTs may less than resolved ts in puller [#927](https://github.com/pingcap/ticdc/pull/927) + - Fix the issue that CommitTs or ResolvedTs (CRTs) might be less than `resolvedTs` in puller [#927](https://github.com/pingcap/ticdc/pull/927) - Fix the issue that `changefeed` might be blocked by MySQL driver [#936](https://github.com/pingcap/ticdc/pull/936) + - Fix the incorrect Resolved Ts interval of TiCDC [#8573](https://github.com/tikv/tikv/pull/8573) + Backup & Restore (BR) From 99326dba3c4bfe84b014796cc5498f2a9c342de1 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 15 Sep 2020 14:18:46 +0800 Subject: [PATCH 28/32] minor update Signed-off-by: Ran --- releases/release-4.0.6.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index cded0d5ee9459..5d24661220e60 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -33,7 +33,7 @@ TiDB version: 4.0.6 - Replace error codes and messages with standard errors [#19888](https://github.com/pingcap/tidb/pull/19888) - Improve the write performance of partitioned table [#19649](https://github.com/pingcap/tidb/pull/19649) - - Record more RPC runtime information in cop runtime stats [#19264](https://github.com/pingcap/tidb/pull/19264) + - Record more RPC runtime information in Cop Runtime statistics [#19264](https://github.com/pingcap/tidb/pull/19264) - Forbid creating tables in `metrics_schema` and `performance_schema` [#19792](https://github.com/pingcap/tidb/pull/19792) - Support adjusting the concurrency of the union executor [#19886](https://github.com/pingcap/tidb/pull/19886) - Support out join in broadcast join [#19664](https://github.com/pingcap/tidb/pull/19664) From b7d7128b115a4f6a8697d1c95a91e50a3cb1a229 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 15 Sep 2020 14:19:37 +0800 Subject: [PATCH 29/32] Apply suggestions from code review --- releases/release-4.0.6.md | 1 - 1 file changed, 1 deletion(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 55b6d9c036f60..62211e3e22db6 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -149,7 +149,6 @@ TiDB version: 4.0.6 - Fix the estimation error for a non-index column when collation is enabled [#8620](https://github.com/tikv/tikv/pull/8620) - Fix the issue that Green GC might miss locks during the process of Region transfer [#8460](https://github.com/tikv/tikv/pull/8460) - - Fix the CDC incorrect resolved TS timeout [#8573](https://github.com/tikv/tikv/pull/8573) - Fix a panic issue that occurs when TiKV runs very slowly during configuration change [#8497](https://github.com/tikv/tikv/pull/8497) - Fix the deadlock issue that occurs between the PD client thread and other threads when calling PD sync requests [#8612](https://github.com/tikv/tikv/pull/8612) - Upgrade jemalloc to v5.2.1 to address the issue of memory allocation in huge page [#8463](https://github.com/tikv/tikv/pull/8463) From 9faa908120a7c1ef8de7161fe85b3ee6ff745803 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 15 Sep 2020 14:39:10 +0800 Subject: [PATCH 30/32] Apply suggestions from code review --- releases/release-4.0.6.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 94f6531b3a5bc..4d081c7bd44ec 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -103,7 +103,7 @@ TiDB version: 4.0.6 - Fix a bug of converting the `enum` and `set` types [#19778](https://github.com/pingcap/tidb/pull/19778) - Add a privilege check for `SHOW STATS_META` and `SHOW STATS_BUCKET` [#19760](https://github.com/pingcap/tidb/pull/19760) - Fix the error of unmatched column lengths caused by `builtinGreatestStringSig` and `builtinLeastStringSig` [#19758](https://github.com/pingcap/tidb/pull/19758) - - Fallback vectorized control expressions [#19749](https://github.com/pingcap/tidb/pull/19749) + - If unnecessary errors or warnings occur, the vectorized control expresions fall back to their scalar execution [#19749](https://github.com/pingcap/tidb/pull/19749) - Fix an error of the `Apply` executor when the type of the correlation column is `Bit` [#19692](https://github.com/pingcap/tidb/pull/19692) - Fix an issue that occurs when the user queries `processlist` and `cluster_log` in MySQL 8.0 client [#19690](https://github.com/pingcap/tidb/pull/19690) - Fix an issue that plans of the same type have different plan digests [#19684](https://github.com/pingcap/tidb/pull/19684) @@ -149,7 +149,7 @@ TiDB version: 4.0.6 - Fix the estimation error for a non-index column when collation is enabled [#8620](https://github.com/tikv/tikv/pull/8620) - Fix the issue that Green GC might miss locks during the process of Region transfer [#8460](https://github.com/tikv/tikv/pull/8460) - - Fix a panic issue that occurs when TiKV runs very slowly during configuration change [#8497](https://github.com/tikv/tikv/pull/8497) + - Fix a panic issue that occurs when TiKV runs very slowly during Raft membership change [#8497](https://github.com/tikv/tikv/pull/8497) - Fix the deadlock issue that occurs between the PD client thread and other threads when calling PD sync requests [#8612](https://github.com/tikv/tikv/pull/8612) - Upgrade jemalloc to v5.2.1 to address the issue of memory allocation in huge page [#8463](https://github.com/tikv/tikv/pull/8463) - Fix the issue that the unified thread pool hangs for long-running queries [#8427](https://github.com/tikv/tikv/pull/8427) From 098954110b8613caffccfd717290c5d40b190bf9 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 15 Sep 2020 14:41:02 +0800 Subject: [PATCH 31/32] Apply suggestions from code review --- releases/release-4.0.6.md | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 4d081c7bd44ec..308ede1bbed2c 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -59,7 +59,9 @@ TiDB version: 4.0.6 - Update TiDB Dashboard to v2020.09.08.1 [#2928](https://github.com/pingcap/pd/pull/2928) - Add more metrics for Region and store heartbeat [#2891](https://github.com/tikv/pd/pull/2891) - Change back to the original way to control the low space threshold [#2875](https://github.com/pingcap/pd/pull/2875) - - Support standard error codes [#2918](https://github.com/tikv/pd/pull/2918) [#2911](https://github.com/tikv/pd/pull/2911) [#2913](https://github.com/tikv/pd/pull/2913) [#2915](https://github.com/tikv/pd/pull/2915) [#2912](https://github.com/tikv/pd/pull/2912) [#2907](https://github.com/tikv/pd/pull/2907) [#2906](https://github.com/tikv/pd/pull/2906) [#2903](https://github.com/tikv/pd/pull/2903) [#2806](https://github.com/tikv/pd/pull/2806) [#2900](https://github.com/tikv/pd/pull/2900) [#2902](https://github.com/tikv/pd/pull/2902) + - Support standard error codes + - [#2918](https://github.com/tikv/pd/pull/2918) [#2911](https://github.com/tikv/pd/pull/2911) [#2913](https://github.com/tikv/pd/pull/2913) [#2915](https://github.com/tikv/pd/pull/2915) [#2912](https://github.com/tikv/pd/pull/2912) [#2907](https://github.com/tikv/pd/pull/2907) + - [#2906](https://github.com/tikv/pd/pull/2906) [#2903](https://github.com/tikv/pd/pull/2903) [#2806](https://github.com/tikv/pd/pull/2806) [#2900](https://github.com/tikv/pd/pull/2900) [#2902](https://github.com/tikv/pd/pull/2902) + TiFlash From 58e86143035b8ccc2bca32e9b2139b4021047968 Mon Sep 17 00:00:00 2001 From: Ran Date: Tue, 15 Sep 2020 16:38:54 +0800 Subject: [PATCH 32/32] update format Signed-off-by: Ran --- releases/release-4.0.6.md | 28 ++++++++++++++-------------- 1 file changed, 14 insertions(+), 14 deletions(-) diff --git a/releases/release-4.0.6.md b/releases/release-4.0.6.md index 308ede1bbed2c..0f78b68b7e68a 100644 --- a/releases/release-4.0.6.md +++ b/releases/release-4.0.6.md @@ -34,7 +34,7 @@ TiDB version: 4.0.6 - Replace error codes and messages with standard errors [#19888](https://github.com/pingcap/tidb/pull/19888) - Improve the write performance of partitioned table [#19649](https://github.com/pingcap/tidb/pull/19649) - - Record more RPC runtime information in Cop Runtime statistics [#19264](https://github.com/pingcap/tidb/pull/19264) + - Record more RPC runtime information in `Cop Runtime` statistics [#19264](https://github.com/pingcap/tidb/pull/19264) - Forbid creating tables in `metrics_schema` and `performance_schema` [#19792](https://github.com/pingcap/tidb/pull/19792) - Support adjusting the concurrency of the union executor [#19886](https://github.com/pingcap/tidb/pull/19886) - Support out join in broadcast join [#19664](https://github.com/pingcap/tidb/pull/19664) @@ -51,7 +51,7 @@ TiDB version: 4.0.6 - Reduce QPS drop when `DropTable` or `TruncateTable` is being executed [#8627](https://github.com/tikv/tikv/pull/8627) - Support generating metafile of error codes [#8619](https://github.com/tikv/tikv/pull/8619) - - Add performance statistics for cf scan detail [#8618](https://github.com/tikv/tikv/pull/8618) + - Add performance statistics for cf scan details [#8618](https://github.com/tikv/tikv/pull/8618) - Add the `rocksdb perf context` panel in the Grafana default template [#8467](https://github.com/tikv/tikv/pull/8467) + PD @@ -66,7 +66,7 @@ TiDB version: 4.0.6 + TiFlash - Add Grafana panels for data replication (`apply Region snapshots` and `ingest SST files`) - - Add Grafana panels for write stall + - Add Grafana panels for `write stall` - Add `dt_segment_force_merge_delta_rows` and `dt_segment_force_merge_delta_deletes` to adjust the threshold of `write stall` - Support setting `raftstore.snap-handle-pool-size` to `0` in TiFlash-Proxy to disable applying Region snapshot by multi-thread to reduce memory consumption during data replication - Support CN check on `https_port` and `metrics_port` @@ -89,7 +89,7 @@ TiDB version: 4.0.6 + TiDB Lightning - - Split and ingest Region in more precise sizes [#369](https://github.com/pingcap/tidb-lightning/pull/369) + - Split and ingest Regions in more precise sizes [#369](https://github.com/pingcap/tidb-lightning/pull/369) + TiDB Binlog @@ -99,7 +99,7 @@ TiDB version: 4.0.6 + TiDB - - Fix an issue of `tikv_cop_wait` time in metric profile [#19881](https://github.com/pingcap/tidb/pull/19881) + - Fix an issue of collecting the `tikv_cop_wait` time in metric profile [#19881](https://github.com/pingcap/tidb/pull/19881) - Fix the wrong result of `SHOW GRANTS` [#19834](https://github.com/pingcap/tidb/pull/19834) - Fix the incorrect query result of `!= ALL (subq)` [#19831](https://github.com/pingcap/tidb/pull/19831) - Fix a bug of converting the `enum` and `set` types [#19778](https://github.com/pingcap/tidb/pull/19778) @@ -118,19 +118,19 @@ TiDB version: 4.0.6 - Fix a bug that the `SHOW GRANTS` statement shows grants for non-existent users [#19588](https://github.com/pingcap/tidb/pull/19588) - Fix a query error when there is an `Apply` executor upon `IndexLookupJoin` [#19566](https://github.com/pingcap/tidb/pull/19566) - Fix the wrong results when converting `Apply` to `HashJoin` on a partitioned table [#19546](https://github.com/pingcap/tidb/pull/19546) - - Fix incorrect results when there is an `IndexLookUp` executor under the inner side of an `Apply` [#19508](https://github.com/pingcap/tidb/pull/19508) + - Fix incorrect results when there is an `IndexLookUp` executor on the inner side of an `Apply` [#19508](https://github.com/pingcap/tidb/pull/19508) - Fix an unexpected panic when using view [#19491](https://github.com/pingcap/tidb/pull/19491) - - Fix an incorrect result of `anti-semi-join` query [#19477](https://github.com/pingcap/tidb/pull/19477) - - Fix a bug that topN statistics is not deleted when the statistics is dropped [#19465](https://github.com/pingcap/tidb/pull/19465) + - Fix an incorrect result of the `anti-semi-join` query [#19477](https://github.com/pingcap/tidb/pull/19477) + - Fix a bug that the `TopN` statistics is not deleted when the statistics is dropped [#19465](https://github.com/pingcap/tidb/pull/19465) - Fix a wrong result caused by mistaken usage of batch point get [#19460](https://github.com/pingcap/tidb/pull/19460) - Fix a bug that a column cannot be found in `indexLookupJoin` with a virtual generated column [#19439](https://github.com/pingcap/tidb/pull/19439) - Fix an error that different plans of the `select` and `update` queries compare datum [#19403](https://github.com/pingcap/tidb/pull/19403) - - Fix a data race for TiFlash work index in region cache [#19362](https://github.com/pingcap/tidb/pull/19362) + - Fix a data race for TiFlash work index in Region cache [#19362](https://github.com/pingcap/tidb/pull/19362) - Fix a bug that the `logarithm` function does not show a warning [#19291](https://github.com/pingcap/tidb/pull/19291) - - Fix an unexpected error that occurs when TiDB persists data to disk [#19272](https://github.com/pingcap/tidb/pull/19272) + - Fix an unexpected error that occurs when TiDB persists data to disks [#19272](https://github.com/pingcap/tidb/pull/19272) - Support using a single partitioned table on the inner side of index join [#19197](https://github.com/pingcap/tidb/pull/19197) - Fix the wrong hash key value generated for decimal [#19188](https://github.com/pingcap/tidb/pull/19188) - - Fix an issue that TiDB returns an `no regions` error when table endKey and region endKey are the same [#19895](https://github.com/pingcap/tidb/pull/19895) + - Fix an issue that TiDB returns a `no regions` error when table endKey and region endKey are the same [#19895](https://github.com/pingcap/tidb/pull/19895) - Fix the unexpected success of alter partition [#19891](https://github.com/pingcap/tidb/pull/19891) - Fix the wrong value of the default maximum packet length allowed for pushed down expressions [#19876](https://github.com/pingcap/tidb/pull/19876) - Fix a wrong behavior for the `Max`/`Min` functions on the `ENUM`/`SET` columns [#19869](https://github.com/pingcap/tidb/pull/19869) @@ -145,7 +145,7 @@ TiDB version: 4.0.6 - Make the `add index` operation that has a generated column with the `case-when` expression can exit normally when it encounters a parse error [#19395](https://github.com/pingcap/tidb/pull/19395) - Fix a bug that DDL takes too long to retry [#19488](https://github.com/pingcap/tidb/pull/19488) - Make statements like `alter table db.t1 add constraint fk foreign key (c2) references t2(c1)` execute without first executing `use db` [#19471](https://github.com/pingcap/tidb/pull/19471) - - Change the dispatch error from an Error to an Info message in the server log file [#19454](https://github.com/pingcap/tidb/pull/19454) + - Change the dispatch error from an `Error` to an `Info` message in the server log file [#19454](https://github.com/pingcap/tidb/pull/19454) + TiKV @@ -183,10 +183,10 @@ TiDB version: 4.0.6 - Fix the issue that `changefeed` might be blocked by MySQL driver [#936](https://github.com/pingcap/ticdc/pull/936) - Fix the incorrect Resolved Ts interval of TiCDC [#8573](https://github.com/tikv/tikv/pull/8573) - + Backup & Restore (BR) + + BR - Fix a panic that might occur during checksum [#479](https://github.com/pingcap/br/pull/479) - - Fix a panic that might occur after the change of PD leader [#496](https://github.com/pingcap/br/pull/496) + - Fix a panic that might occur after the change of PD Leader [#496](https://github.com/pingcap/br/pull/496) + Dumpling