Skip to content

Release-2.4.0

Compare
Choose a tag to compare
@ruanhang1993 ruanhang1993 released this 25 Jun 08:02
· 573 commits to master since this release

Release Notes

Documentation: https://ververica.github.io/flink-cdc-connectors/release-2.4

Features and Improvements

  1. [hotfix] Add vitess connector to the release profile
  2. [docs][hotfix] Update debezium reference links to 1.9 version
  3. [build] Update the copyright year to 2023 (#2205)
  4. [postgres] Fix postgres e2e test
  5. [postgres] scan.incremental.snapshot.enabled is closed by default
  6. [postgres] Backfill task will be able to end when there is not new change data but read the ending lsn
  7. [postgres] Create slot for backfill task before snapshot reading
  8. [postgres] Prepare a slot for the unique global stream split
  9. [mysql] Fix GTID issues to recover from checkpoint normally in specifying startup mode (#2220)
  10. [doc][hotfix] Fix driver version and correct vitess doc path (#2224)
  11. [vitess] Add e2e case for Vitess connector
  12. [vitess] Add Vitess tests in Azure pipeline
  13. [vitess] Add Vitess CDC connector (#456)
  14. [debezium] Bump debezium version to 1.9.7.Final (#2156)
  15. [oracle] Fix the backfill task not running bug in oracle cdc connector (#2218)
  16. [hotfix][sqlserver] Merge high and low watermark data during snapshot reading process (#2179)
  17. [Postgres] Use Incremental Snapshot Framework for Postgres CDC Connector (#2216)
  18. [oracle] Fix the incremental phase not skip the data that has been read in the snapshot full phase (#2215)
  19. [mongodb] Support specific timestamp startup mode. (#2207)
  20. [tests][mysql] Shutdown mysql container timely for legacy mysql tests
  21. [mongodb][hotfix] Fix regex inference of database or collection only contains dash. (#2209)
  22. [hotfix][build] Use different name for each job
  23. [hotfix][Mysql] MySqlBinlogSplitAssigner should support method isStreamSplitAssigned
  24. [MySQL] Remove deleted tables when using a new table filter and restarting from checkpoint
  25. [build][mysql][e2e] Increase the azure test job timeout to 90 minutes
  26. [mysql] Fix MySql CDC Connector outputs duplicated binlog when enable newly-added-table
  27. [mysql][minor] Print clear log information for key path
  28. [mongodb][hotfix] Fix drop or rename record cause documentKey being empty. (#2210)
  29. [ci][oceanbase] Only compile necessary modules for self hosted pipeline
  30. [doc] Add docs for close idle readers feature. (#2208)
  31. [cdc-base] Close idle readers when snapshot finished (#2202)
  32. [mongodb] Add support for mongodb+srv connection protocol. (#2203)
  33. [oceanbase] Always cleanup resources after reading before exit (#2189)
  34. [mongodb][hotfix] Fix NullPointerException when executing ddl operation in MongoDB (#2107)
  35. [mysql-cdc] Supports MYSQL_TYPE_TYPED_ARRAY column type when parsing the table map event
  36. [mysql-cdc][hotfix] Optimize the error msg when binlog expire in source
  37. [mysql-cdc] Optimize the error msg when binlog expire or server id conflict This closes #2010.
  38. [oceanbase] add jdbc options and support oracle mode (#1854)
  39. [mysql-cdc] Add handler for catching async exceptions in snapshot reading executor This closes #2016.
  40. [hotfix][mysql-cdc] Use session timezone instead of local time zone as the default server time zone
  41. [mysql] Fix NullPointerException when database name or table name contains dot
  42. [mysql] Fix NullPointerException caused by mysql ignores the capitalization when splitting chunks
  43. [sqlserver] Fix old change data that will be captured when the latest mode starts (#2176)
  44. [core] support print configuration options for connectors (#2099)
  45. [oceanbase] support libobcdc 4.x and fix restore timestamp config (#2161)
  46. [sqlserver] Sqlserver incremental source. (#1732)
  47. [OceanBase][test] Update oceanbase and oblogproxy docker image (#2060)
  48. [oceanbase] use real charset to convert change record (#2159)
  49. [mysql] Support tables which do not contain a primary key (#2150)
  50. [common] Bump flink to 1.17.0 (#2057)
  51. [doc] add mongodb cdc chinese doc (#2042)
  52. [hotfix][test] ignore OracleConnectorITCase.testConsumingAllEvents util issue 1875 fix (#2111)
  53. [docs][db2] Correct CHAR(n) to CHARACTER(n) (#2052)
  54. [postgres] Change config option slot.name to be required (#1996)
  55. [docs] Update the outdated DingTalk QR code
  56. [mongodb][hotfix] Fix pollAwaitTimeMillis does not take effect (#1995)
  57. [tests][mysql] Skip unnecessary IT Cases which uses legacy debezium source implementation
  58. [mysql] Add note for MySQL TINYINT(1) type to Flink SQL Boolean type
  59. [github] Minor typo in issue bug-report (#2020)
  60. [mysql-cdc] Fix race condition between split and coordinator thread that async exception might not be caught
  61. [mysql/oracle] Fix the wrong comments in ChunkSplitter
  62. [hotfix][docs] Correct the flink file path in MySQL docs
  63. [hotfix][mongodb] Fix resume token not found #1879 (#1938)
  64. [mongodb][hotfix] Fix authentication failed when using a non admin auth source and duplicated usernames #1934 (#1935)
  65. [mysql] Add various test cases to cover newly added table process from read binlog blocking to read binlog un-blocking
  66. [hotfix][base] Fix typo in java docs
  67. [mysql] Optimize the newly added table process from read binlog blocking to read binlog un-blocking
  68. [minor][mysql] Rename SplitsSize to SplitsNumber
  69. [hotfix][mysql] Correct meta group id as it is 0 based
  70. [hotfix][base][tidb][mysql] Fix wrong condition for execution timeout
  71. [mongodb] Improve code structure (#1900)
  72. [build] Use issue form templates (#1830)
  73. [ci] Fix for dubious repo ownership issue (#1843)
  74. [docs] Update mysql-cdc.md to recommend latest version (#1842)
  75. [ci] Fix for dubious repo ownership issue (#1840)
  76. [docs][sqlserver] Update data type mapping (#1802)
  77. [ci][tidb] Fix dns cache works incorrect in latest jdk 8. (#1809)
  78. [postgresql] Upgrade postgresql driver from 42.2.26 to 42.2.27 to avoid CVE-2022-41946 (#1773)
  79. [minor][common] Improve the changelogMode expression (#1793)
  80. [hotfix][debezium] Forward root cause in DebeziumSourceFunction (#1791)
  81. [docs][oracle] Add new introduced config options from incremental snapshot framework (#1719)
  82. [mysql] Fix backward compatibility on deserializing binlog offset from old versions (#1758)
  83. [hotfix][docs] Correct the startup option's data type in Mysql docs and duplicate batch.size in MongoDB docs (#1751)
  84. [hotfix][docs] Correct the mysql driver version in MySQL docs
  85. [docs][site] update the supported cdc connectors picture
  86. [oracle] Add missing supported config options for oracle table source (#1727)

Contributor List (sorted alphabetically)

  1. Hang Ruan
  2. He Wang
  3. JasonLee
  4. Jiabao Sun
  5. Jingsong Lee
  6. Xiao Meng
  7. Leonard Xu
  8. Qingsheng Ren
  9. Robert Metzger
  10. Sergey Nuyanzin
  11. Simonas Gelazevicius
  12. Yaroslav Tkachenko
  13. Tigran Manasyan
  14. Tyrantlucifer
  15. ZhongLinLeo
  16. bb chen
  17. ehui
  18. emhui
  19. gintarasm
  20. gongzhongqiang
  21. liangyaohui97
  22. lin.zl
  23. molsionmo
  24. skylines
  25. tison
  26. wallkop
  27. wangxiaojing
  28. wuzhenhua
  29. xixingya
  30. zhaomin
  31. zhuyuan03
  32. 含风