From 533fd31430591203039142658709bc9b5cab8ff9 Mon Sep 17 00:00:00 2001 From: Ran Date: Thu, 17 Nov 2022 16:59:56 +0800 Subject: [PATCH] docs: update roadmap for 202211 (#39149) --- roadmap.md | 67 ++++++++++++++++++++++++++++++++---------------------- 1 file changed, 40 insertions(+), 27 deletions(-) diff --git a/roadmap.md b/roadmap.md index 92de0e67c7f34..e311b85b932a0 100644 --- a/roadmap.md +++ b/roadmap.md @@ -2,6 +2,8 @@ This roadmap brings you what's coming in the 1-year future, so you can see the new features or improvements in advance, follow the progress, learn about the key milestones on the way, and give feedback as the development work goes on. In the course of development, this roadmap is subject to change based on user needs and feedback. If you have a feature request or want to prioritize a feature, please file an issue on [GitHub](https://github.com/pingcap/tidb/issues). +✅: The feature or improvement is already available in TiDB. + > **Safe harbor statement:** > > *Any unreleased features discussed or referenced in our documents, roadmaps, blogs, websites, press releases, or public statements that are not currently available ("unreleased features") are subject to change at our discretion and may not be delivered as planned or at all. Customers acknowledge that purchase decisions are solely based on features and functions that are currently available, and that PingCAP is not obliged to deliver aforementioned unreleased features as part of the contractual agreement unless otherwise stated.* @@ -19,7 +21,7 @@ This roadmap brings you what's coming in the 1-year future, so you can see the n Scalability & Stability - Support resource management framework. + @@ -31,13 +33,12 @@ This roadmap brings you what's coming in the 1-year future, so you can see the n Support dynamic region size adjustment (heterogeneous) and huge region size for scenarios with fast business growth and a large amount of data. - SQL - Support the JSON function. + SQL + Support the JSON function. In business scenarios that require flexible schema definitions, the application can use JSON to store information for ODS, transaction indicators, commodities, game characters, and props. - Support cluster-level flashback. + In game rollback scenarios, the flashback can be used to achieve a fast rollback of the current cluster. This solves the common problems in the gaming industry such as version errors and bugs. @@ -45,7 +46,15 @@ This roadmap brings you what's coming in the 1-year future, so you can see the n This feature enables automatic data cleanup in limited data archiving scenarios. - Implement a DDL parallel execution framework. + Support foreign key constraints. + Supports foreign key constraints compatible with MySQL syntax, and provides DB-level referential integrity check capabilities. + + + Support non-transactional DML for insert and update operations. + + + + Implement a distributed parallel DDL execution framework, so that DDL tasks executed by only one TiDB Owner node can be coordinated and executed by all TiDB nodes in the cluster. Improve the execution speed of DDL tasks and cluster resource utilization.
By converting the execution of DDL tasks to distributed mode, this feature accelerates the execution speed of DDL tasks and improves the utilization of computing resources in the entire cluster. At present, DDL tasks that need to improve the speed include large table indexing and lossy column type modification tasks. @@ -54,14 +63,9 @@ This roadmap brings you what's coming in the 1-year future, so you can see the n

Support INSERT INTO SELECT.

These features combined enable a way to materialize intermediate results. The analysis results can be easily reused, which reduces unnecessary ad-hoc queries, improves the performance of BI and other applications (by pulling results directly) and reduces system load (by avoiding duplicated computation), thereby improving the overall data pipeline efficiency and reducing costs. It will make TiFlash an online service.

- Support FastScan for TiFlash. + ✅ Support FastScan for TiFlash.

This feature improves the basic computing capability of TiFlash, and optimizes the performance and reliability of the underlying algorithms of the columnar storage and MPP engine.

- - Proxy - Support TiDB proxy. - Implement automatic load balancing so that upgrading a cluster or modifying configurations does not affect the application. After scaling out or scaling in the cluster, the application can automatically rebalance the connection without reconnecting.
In scenarios such as upgrades and configuration changes, TiDB proxy is more business-friendly. - Maintenance Support rule-based SQL blocklist. @@ -82,9 +86,13 @@ This roadmap brings you what's coming in the 1-year future, so you can see the n - SQL tuning for HTAP workloads - - + SQL tuning for HTAP workloads + Provide SQL execution information from the perspective of applications. + Provide a dashboard that displays a SQL execution overview from the perspective of applications in HTAP workloads. + + + Provide suggestions on optimizing SQL for TiFlash and TiKV in HTAP workloads. + For one or several HTAP scenarios, provide suggestions on SQL optimization. @@ -112,8 +120,8 @@ This roadmap brings you what's coming in the 1-year future, so you can see the n Data replication to downstream systems via TiCDC - Reduce TiCDC replication latency in daily operations. - When TiKV, TiDB, PD, or TiCDC nodes are offline in a planned maintenance window, the replication latency of TiCDC can be reduced to less than 10 seconds. + Improve TiCDC scalability and reduce replication latency. + Increase TiCDC's scalability by spanning data changes for single table to multiple TiCDC nodes and reduce replication latency by removing sorting stage. Support replicating data to object storage such as S3. @@ -121,8 +129,8 @@ This roadmap brings you what's coming in the 1-year future, so you can see the n Data migration - TiDB Lightning supports table-level and partition-level online data import. - TiDB Lightning provides comprehensive table-level and partition-level data import capabilities. + Continuous data verification during data migration. + DM supports online data verification during migration from MySQL compatible database to TiDB. @@ -138,11 +146,6 @@ This roadmap brings you what's coming in the 1-year future, so you can see the n - - Log redaction - - Redact sensitive information in execution plans and various logs to enhance the security of user data. - Password complexity check A strong password is required. @@ -154,9 +157,19 @@ This roadmap brings you what's coming in the 1-year future, so you can see the n Reduce the security risk of password cracking or leakage caused by using the same password for a long time. - Password policy management - TiDB provides a password reuse mechanism and brute-force cracking prevention capabilities. - TiDB supports password policy management to protect password security. + Password reuse policy + TiDB provides a password reuse policy. + Restrict password reuse and improve password security. + + + Password anti-brute force cracking + Accounts will be locked in case of consecutive incorrect passwords. + Lock the account under continuous wrong passwords to prevent the password from being cracked by brute force. + + + Log redaction + + Redact sensitive information in execution plans and various logs to enhance the security of user data. Column-level access control