Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

releases: add v5.3.2 release notes #9914

Merged
merged 36 commits into from
Jun 29, 2022
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
9bef8f0
add v5.3.2 release notes
ran-huang Jun 20, 2022
5644601
Update releases/release-5.3.2.md
ran-huang Jun 23, 2022
c2757d7
add tidb notes
ran-huang Jun 23, 2022
623a72c
add tiflash notes
ran-huang Jun 23, 2022
8814d2d
add tikv notes
ran-huang Jun 23, 2022
b3b0208
add ticdc/dm notes
ran-huang Jun 23, 2022
143552b
add one tidb note
ran-huang Jun 23, 2022
fa2af6b
Update releases/release-5.3.2.md
ran-huang Jun 23, 2022
b816e34
Update releases/release-5.3.2.md
ran-huang Jun 23, 2022
eb89193
add pd notes
ran-huang Jun 23, 2022
310bd76
resolve conflict
ran-huang Jun 23, 2022
924c4ef
add missing notes from english
ran-huang Jun 23, 2022
1a09a97
mark dup notes
ran-huang Jun 23, 2022
f980015
fix typo
Oreoxmt Jun 24, 2022
d7842e9
Update releases/release-5.3.2.md
TomShawn Jun 27, 2022
13a1801
Apply suggestions from code review
Oreoxmt Jun 27, 2022
708a5b1
Apply suggestions from code review
Oreoxmt Jun 27, 2022
4a4483b
revert a mistake
ran-huang Jun 27, 2022
3132c08
Apply suggestions from code review
qiancai Jun 28, 2022
2b5331e
update dup notes
ran-huang Jun 28, 2022
0f37aad
Merge branch '5.3.2-release-notes' of https://github.com/ran-huang/do…
ran-huang Jun 28, 2022
a123ac1
Apply suggestions from code review
shichun-0415 Jun 28, 2022
48e9b27
Update releases/release-5.3.2.md
TomShawn Jun 28, 2022
a25216b
Apply suggestions from code review
Oreoxmt Jun 28, 2022
3d2221e
Update releases/release-5.3.2.md
ran-huang Jun 28, 2022
a6f3d01
Update releases/release-5.3.2.md
qiancai Jun 28, 2022
9d15c8a
Update releases/release-5.3.2.md
qiancai Jun 28, 2022
4debdf4
Update releases/release-5.3.2.md
ran-huang Jun 28, 2022
934f403
Apply suggestions from code review
shichun-0415 Jun 28, 2022
80d93c4
Update releases/release-5.3.2.md
ran-huang Jun 29, 2022
5ad4e6c
Update releases/release-5.3.2.md
ran-huang Jun 29, 2022
129ea83
replace duplicated notes
ran-huang Jun 29, 2022
f247d17
move pd note
ran-huang Jun 29, 2022
6c28d96
remove unnecessary tikv note
ran-huang Jun 29, 2022
3ab48f2
add compatibility change notes
ran-huang Jun 29, 2022
c0305dc
Update releases/release-5.3.2.md
ran-huang Jun 29, 2022
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions TOC.md
Original file line number Diff line number Diff line change
Expand Up @@ -870,6 +870,7 @@
- [5.4.1](/releases/release-5.4.1.md)
- [5.4.0](/releases/release-5.4.0.md)
- v5.3
- [5.3.2](/releases/release-5.3.2.md)
- [5.3.1](/releases/release-5.3.1.md)
- [5.3.0](/releases/release-5.3.0.md)
- v5.2
Expand Down
159 changes: 159 additions & 0 deletions releases/release-5.3.2.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,159 @@
---
title: TiDB 5.3.2 Release Notes
---

# TiDB 5.3.2 Release Notes

发版日期:2022 年 6 月 29 日

TiDB 版本:5.3.2

## 兼容性变更

+ TiDB

- 修复当 auto ID 超出范围时,`REPLACE` 语句错误地修改了其它行的问题 [#29483](https://github.com/pingcap/tidb/issues/29483)

ran-huang marked this conversation as resolved.
Show resolved Hide resolved
+ PD
Oreoxmt marked this conversation as resolved.
Show resolved Hide resolved

- 默认关闭编译 swagger server [#4932](https://github.com/tikv/pd/issues/4932)

## 提升改进

+ TiKV

- 减少 Raft 客户端的系统调用并提高 CPU 效率 [#11309](https://github.com/tikv/tikv/issues/11309)
- 健康检查可以检测到无法正常工作的 Raftstore,使得 TiKV client 可以及时更新 Region Cache [#12398](https://github.com/tikv/tikv/issues/12398)
- 通过将 leader 转让给 CDC observer 减少延迟抖动 [#12111](https://github.com/tikv/tikv/issues/12111)
- 在 Raft 日志垃圾回收模块中添加了更多监控指标,从而定位该模块中出现的性能问题 [#11374](https://github.com/tikv/tikv/issues/11374)

+ Tools

+ TiDB Data Migration (DM)

- 支持 Syncer 使用 DM-worker 的工作目录写内部文件,不再使用 `/tmp` 目录。任务停止后会清理掉该目录 [#4107](https://github.com/pingcap/tiflow/issues/4107)

+ TiDB Lightning

- 优化 Scatter Region 为批量模式,提升 Scatter Region 过程的稳定性 [#33618](https://github.com/pingcap/tidb/issues/33618)

## Bug 修复
ran-huang marked this conversation as resolved.
Show resolved Hide resolved
ran-huang marked this conversation as resolved.
Show resolved Hide resolved
ran-huang marked this conversation as resolved.
Show resolved Hide resolved

ran-huang marked this conversation as resolved.
Show resolved Hide resolved
+ TiDB

- 修复了 Amazon S3 无法正确计算压缩数据大小的问题 [#30534](https://github.com/pingcap/tidb/issues/30534)
- 修复乐观事务下数据索引可能不一致的问题 [#30410](https://github.com/pingcap/tidb/issues/30410)
- 修复当 SQL 语句中存在 JSON 类型列与 `CHAR` 类型列连接时,SQL 出错的问题 [#29401](https://github.com/pingcap/tidb/issues/29401)
- 如果发生网络连接问题,TiDB 并不总是能正确释放已断开会话所占有的资源。该修复可以确保 TiDB 回滚打开的事务以及释放其他相关资源。[#34722](https://github.com/pingcap/tidb/issues/34722)
- 修复开启 TiDB Binlog 后插入重复数据导致 `data and columnID count not match` 错误的问题 [#33608](https://github.com/pingcap/tidb/issues/33608)
- 修复在 RC 隔离情况下 Plan Cache 启用时可能导致查询结果错误的问题 [#34447](https://github.com/pingcap/tidb/issues/34447)
- 修复了在 MySQL binary 协议下,当 schema 变更后,执行 prepared statement 会导致会话崩溃的问题 [#33509](https://github.com/pingcap/tidb/issues/33509)
- 修复对于新加入的分区,表属性 (table attributes) 无法被检索到,以及分区更新后,表的 range 信息不会被更新的问题 [#33929](https://github.com/pingcap/tidb/issues/33929)
- 修复了查询 `INFORMATION_SCHEMA.CLUSTER_SLOW_QUERY` 表导致 TiDB 服务器 OOM 的问题,在 Grafana dashboard 中查看慢查询记录的时候可能会触发该问题 [#33893](https://github.com/pingcap/tidb/issues/33893)
- 修复集群的 PD 节点被替换后一些 DDL 语句会卡住一段时间的问题 [#33908](https://github.com/pingcap/tidb/issues/33908)
- 修复了集群从 4.0 版本升级后,为用户授予 `all` 权限时报错的问题 [#33588](https://github.com/pingcap/tidb/issues/33588)
- 修复使用 left join 同时删除多张表数据时可能出现错误结果的问题 [#31321](https://github.com/pingcap/tidb/issues/31321)
- 修复 TiDB 可能向 TiFlash 发送重复任务的问题 [#32814](https://github.com/pingcap/tidb/issues/32814)
- 修复 TiDB 的后台 HTTP 服务可能没有正确关闭导致集群状态异常的问题 [#30571](https://github.com/pingcap/tidb/issues/30571)
- 修复 TiDB 由于 `fatal error: concurrent map read and map write` 发生崩溃的问题 [#35340](https://github.com/pingcap/tidb/issues/35340)

ran-huang marked this conversation as resolved.
Show resolved Hide resolved
+ TiKV

- 修复了 PD 客户端遇到报错时频繁重连的问题 [#12345](https://github.com/tikv/tikv/issues/12345)
- 修复了 `DATETIME` 类型的数据包含小数部分和 `Z` 后缀导致检查报错的问题 [#12739](https://github.com/tikv/tikv/issues/12739)
- 修复了对空字符串进行类型转换导致 TiKV panic 的问题 [#12673](https://github.com/tikv/tikv/issues/12673)
- 修复了在悲观事务中使用 Async Commit 导致重复提交记录的问题 [#12615](https://github.com/tikv/tikv/issues/12615)
- 修复进行 Follower Read 时,可能会报 `invalid store ID 0` 错误的问题 [#12478](https://github.com/tikv/tikv/issues/12478)
- 修复销毁 peer 和批量分裂 Region 之间的竞争导致的 TiKV panic [#12368](https://github.com/tikv/tikv/issues/12368)
- 修复网络出现问题的情况下,已成功提交的乐观事务可能报 `Write Conflict` 错误的问题 [#34066](https://github.com/pingcap/tidb/issues/34066)
- 修复待 merge 的 Region 无效会导致 TiKV panic 且非预期地销毁 peer 的问题 [#12232](https://github.com/tikv/tikv/issues/12232)
- 修复旧信息造成 TiKV panic 的问题 [#12023](https://github.com/tikv/tikv/issues/12023)
- 修复因内存统计指标溢出而造成的间歇性丢包和内存不足 (OOM) 的问题 [#12160](https://github.com/tikv/tikv/issues/12160)
- 修复在 Ubuntu 18.04 下进行性能分析会造成 TiKV panic 的问题 [#9765](https://github.com/tikv/tikv/issues/9765)
- 修复 tikv-ctl 对 `bad-ssts` 结果字符串进行错误匹配的问题 [#12329](https://github.com/tikv/tikv/issues/12329)
- 修复 replica read 可能违反线性一致性的问题 [#12109](https://github.com/tikv/tikv/issues/12109)
- 修复合并 Region 时因 target peer 被一个未进行初始化就被销毁的 peer 所替换,从而引起 TiKV panic 的问题 [#12048](https://github.com/tikv/tikv/issues/12048)
- 修复 TiKV 运行 2 年以上可能 panic 的问题 [#11940](https://github.com/tikv/tikv/issues/11940)

ran-huang marked this conversation as resolved.
Show resolved Hide resolved
+ PD
qiancai marked this conversation as resolved.
Show resolved Hide resolved

- 修复由于 Hot Region 没有 leader 导致 PD Panic 的问题 [#5005](https://github.com/tikv/pd/issues/5005)
- 修复 PD leader 转移后调度不能立即启动的问题 [#4769](https://github.com/tikv/pd/issues/4769)
- 修复已清除的 `tombstone store` 信息在切换 PD leader 后再次出现的问题 [#4941](https://github.com/tikv/pd/issues/4941)
- 修复在某些特殊情况下 TSO fallback 的问题 [#4884](https://github.com/tikv/pd/issues/4884)
- 修复存在较大空间 Store 时(例如 2T),无法检测满的小空间 Store,从而无法进行平衡调度的问题 [#4805](https://github.com/tikv/pd/issues/4805)
- 修复 `SchedulerMaxWaitingOperator` 设置为 `1` 时不产生调度的问题 [#4946](https://github.com/tikv/pd/issues/4946)
- 修复监控信息中已删除 label 的残留问题 [#4825](https://github.com/tikv/pd/issues/4825)

+ TiFlash

- 修复错误地配置存储目录会导致非预期行为的问题 [#4093](https://github.com/pingcap/tiflash/issues/4093)
- 修复 TiFlash 节点上遗留了与 Region range 不匹配的数据的问题 [#4414](https://github.com/pingcap/tiflash/issues/4414)
- 修复在添加一些 `NOT NULL` 的列时报 `TiFlash_schema_error` 的问题 [#4596](https://github.com/pingcap/tiflash/issues/4596)
- 修复由于 `commit state jump backward` 错误导致 TiFlash 反复崩溃的问题 [#2576](https://github.com/pingcap/tiflash/issues/2576)
- 修复大量 INSERT 和 DELETE 操作后可能导致 TiFlash 数据不一致的问题 [#4956](https://github.com/pingcap/tiflash/issues/4956</span>)
- 修复启用本地隧道时取消 MPP 查询可能导致任务永远挂起的问题 [#4229](https://github.com/pingcap/tiflash/issues/4229)
- 修复 TiFlash 使用远程读时可能会误报集群 TiFlash 版本不一致的问题 [#3713](https://github.com/pingcap/tiflash/issues/3713)
- 修复 MPP query 会随机碰到 gRPC keepalive timeout 导致 query 失败的问题 [#4662](https://github.com/pingcap/tiflash/issues/4662)
- 修复 MPP exchange receiver 如果出现大量重试可能会导致 query hang 的问题 [#3444](https://github.com/pingcap/tiflash/issues/3444)
- 修复将 `DATETIME` 转换为 `DECIMAL` 时结果错误的问题 [#4151](https://github.com/pingcap/tiflash/issues/4151)
- 修复将 `FLOAT` 类型转换为 `DECIMAL` 类型可能造成溢出的问题 [#3998](https://github.com/pingcap/tiflash/issues/3998)
- 修复 `json_length` 对空字符串可能会报 `index out of bounds` 错误的问题 [#2705](https://github.com/pingcap/tiflash/issues/2705)
- 修复极端情况下 decimal 比较结果可能有误的问题 [#4512](https://github.com/pingcap/tiflash/issues/4512)
- 修复在执行带有 `JOIN` 的查询遇到错误时可能被挂起的问题 [#4195](https://github.com/pingcap/tiflash/issues/4195)
- 修复查询语句包含 `where <string>` 时查询结果出错的问题 [#3447](https://github.com/pingcap/tiflash/issues/3447)
- 修复 `CastStringAsReal` 在 TiFlash 的行为与在 TiDB、TiKV 的行为不一致的问题 [#3475](https://github.com/pingcap/tiflash/issues/3475)
- 修复转换 string 类型为 datetime 类型时,`microsecond` 结果可能不对的问题 [#3556](https://github.com/pingcap/tiflash/issues/3556)
- 修复查询存在大量 delete 操作的表时可能报错的问题 [#4747](https://github.com/pingcap/tiflash/issues/4747)
- 修复 TiFlash 随机报错 "Keepalive watchdog fired" 的问题 [#4192](https://github.com/pingcap/tiflash/issues/4192)
- 修复 TiFlash 节点上遗留了与 Region range 不匹配的数据的问题 [#4414](https://github.com/pingcap/tiflash/issues/4414)
- 修复 MPP 任务可能永远泄漏线程的问题 [#4238](https://github.com/pingcap/tiflash/issues/4238)
- 修复空 segments 在 GC 后无法合并的问题 [#4511](https://github.com/pingcap/tiflash/issues/4511)
- 修复启用 TLS 时可能导致的崩溃 [#4196](https://github.com/pingcap/tiflash/issues/4196)
- 修复过期数据回收缓慢的问题 [#4146](https://github.com/pingcap/tiflash/issues/4146)
- 修复错误地配置存储目录会导致非预期行为的问题 [#4093](https://github.com/pingcap/tiflash/issues/4093)
- 修复一些异常没有被正确地处理的问题 [#4101](https://github.com/pingcap/tiflash/issues/4101)
- 修复在读取工作量大时添加列后可能出现的查询错误 [#3967](https://github.com/pingcap/tiflash/issues/3967)
- 修复 `STR_TO_DATE()` 函数对微秒前导零的错误解析 [#3557](https://github.com/pingcap/tiflash/issues/3557)
- 修复 TiFlash 重启时偶发的 `EstablishMPPConnection` 错误 [#3615](https://github.com/pingcap/tiflash/issues/3615)

+ Tools

+ Backup & Restore (BR)

- 修复增量恢复后在表中插入记录时遇到的重复主键问题 [#33596](https://github.com/pingcap/tidb/issues/33596)
- 修复了 BR 或 TiDB Lightning 在异常退出的时候,scheduler 没有重置的问题 [#33546](https://github.com/pingcap/tidb/issues/33546)
- 修复增量恢复期间,由于 DDL 查询任务为空导致的报错 [#33322](https://github.com/pingcap/tidb/issues/33322)
- 修复恢复过程中 Region 不一致时 BR 重试次数不足的问题 [#33419](https://github.com/pingcap/tidb/issues/33419)
- 修复了当恢复操作遇到一些无法恢复的错误时,BR 被卡住的问题 [#33200](https://github.com/pingcap/tidb/issues/33200)
- 修复 BR 无法备份 RawKV 的问题 [#32607](https://github.com/pingcap/tidb/issues/32607)
- 修复 BR 无法处理 S3 内部错误的问题 [#34350](https://github.com/pingcap/tidb/issues/34350)

+ TiCDC

- 修复切换 owner 会导致其 metrics 数据不正确的问题 [#4774](https://github.com/pingcap/tiflow/issues/4774)
- 修复 redo log manager 提前 flush log 的问题 [#5486](https://github.com/pingcap/tiflow/issues/5486)
- 修复当一部分表没有被 redo writer 管理时 resolved ts 提前推进的问题 [#5486](https://github.com/pingcap/tiflow/issues/5486)
- 添加 UUID 作为 redo log file 的后缀以解决文件名冲突引起的数据丢失问题 [#5486](https://github.com/pingcap/tiflow/issues/5486)
- 修复 MySQL Sink 可能会保存错误的 checkpointTs 的问题 [#5107](https://github.com/pingcap/tiflow/issues/5107)
- 修复 TiCDC 集群升级后可能会 panic 的问题 [#5266](https://github.com/pingcap/tiflow/issues/5266)
- 修复在同一节点反复调入调出一张表可能会导致同步任务 (changefeed) 被卡住的问题 [#4464](https://github.com/pingcap/tiflow/issues/4464)
- 修复了在开启 TLS 后,`--pd` 中设置的第一个 PD 不可用导致 TiCDC 无法启动的问题 [#4777](https://github.com/pingcap/tiflow/issues/4777)
- 修复当 PD 状态不正常时 OpenAPI 可能会卡住的问题 [#4778](https://github.com/pingcap/tiflow/issues/4778)
- 修复 Unified Sorter 的 workerpool 稳定性问题 [#4447](https://github.com/pingcap/tiflow/issues/4447)
- 修复某些情况下序列对象被错误同步的问题 [#4552](https://github.com/pingcap/tiflow/issues/4552)

+ TiDB Data Migration (DM)

- 修复任务自动恢复后,DM 会占用更多磁盘空间的问题 [#3734](https://github.com/pingcap/tiflow/issues/3734),[#5344](https://github.com/pingcap/tiflow/issues/5344)
- 修复在未设置 `case-sensitive: true` 时无法同步大写表的问题 [#5255](https://github.com/pingcap/tiflow/issues/5255)
- 修复了某些情况下,过滤 DDL 并在下游手动执行会导致同步任务不能自动重试恢复的问题 [#5272](https://github.com/pingcap/tiflow/issues/5272)
- 修复了在 `SHOW CREATE TABLE` 语句返回的索引中,主键没有排在第一位导致的 DM worker panic 的问题 [#5159](https://github.com/pingcap/tiflow/issues/5159)
- 修复了当开启 GTID 模式或者任务自动恢复时,可能出现一段时间 CPU 占用高并打印大量日志的问题 [#5063](https://github.com/pingcap/tiflow/issues/5063)
- 修复重启 DM-master 后 relay log 可能会被关闭的问题 [#4803](https://github.com/pingcap/tiflow/issues/4803)

+ TiDB Lightning

ran-huang marked this conversation as resolved.
Show resolved Hide resolved
- 修复由 `auto_increment` 列的数据越界导致 local 模式导入失败的问题 [#29737](https://github.com/pingcap/tidb/issues/27937)
- 修复前置检查中没有检查本地磁盘空间以及集群是否可用的问题 [#34213](https://github.com/pingcap/tidb/issues/34213)
- 修复了 checksum 报错 “GC life time is shorter than transaction duration” [#32733](https://github.com/pingcap/tidb/issues/32733)
1 change: 1 addition & 0 deletions releases/release-notes.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,6 +22,7 @@ TiDB 历史版本发布声明如下:

## 5.3

- [5.3.2](/releases/release-5.3.2.md)
- [5.3.1](/releases/release-5.3.1.md)
- [5.3.0](/releases/release-5.3.0.md)

Expand Down
1 change: 1 addition & 0 deletions releases/release-timeline.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,7 @@ summary: 了解 TiDB 的版本发布时间线。

| 版本 | 发布日期 |
| :--- | :--- |
| [5.3.2](/releases/release-5.3.2.md) | 2022-06-xx |
| [6.1.0](/releases/release-6.1.0.md) | 2022-06-13 |
| [5.4.1](/releases/release-5.4.1.md) | 2022-05-13 |
| [5.2.4](/releases/release-5.2.4.md) | 2022-04-26 |
Expand Down