[TOC] DSIP Collection

[zhongjiajie]

What is it?

This is a TOC of DSIP, it helps the community to add, update, track DSIP easier. Also, it can help users know what the community do(or doing)

What is the DSIP format?

You should write the below content at DSIP.

### Motivation

### Design Detail

### Compatibility, Deprecation, and Migration Plan

### Test Plan

How to use it?

• You want to introduce a new DSIP: When new introduce a new DSIP, you should see the next DSIP number from this issue and create a new one plus one from the biggest one we list here (only parent DSIP should add to this issue, sub-task could add to your parent's one).
• You want to find an existing DSIP: For users who want to deep into the detailed design or want to continue the inactivity DSIP(sub-task of DSIP), you can go to this issue and find still open DSIP and leave comment to your interested one

DSIP TOC

• [DSIP-1][Feature][Parent] Add Python API for DolphinScheduler #6407
• [DSIP-2][Doc] Refactor the document #6535
• [DSIP-3][Performance Improvement] Performance improvement for ds 2.0 #6666
• [DSIP-4][Feature][UI Next] A new version of the UI proposal. #7332
• [DSIP-5][Feature][python] Add CLI to Python API  #8517
• [DSIP-6][k8s] k8s on dolphinscheduler #9312
• [DSIP-7] [API] Suggest refactor the backend api #10257
• [DSIP-8][Metrics] Improve DolphinScheduler Monitoring #9324
• [DSIP-9][Feature][Server] Add new registry plugin based on raft #10874
• [DSIP-10][Unit Tests] Improve DolphinScheduler unit tests #10573
• [DSIP-11][Feature][python] Use the pydolphinscheduler to dynamically generate workflows from the configuration file #10995
• [DSIP-12][Feature] Add java SDK for DolphinScheduler #7946
• [DSIP-13][Feature][Python] Adding a resource file loading plugin to the DolphinScheduler Python API  #10911
• [DSIP-14][Improvement] Add api tests and integration tests for Apache DolphinScheduler  #10411
• [DSIP-15][UI][Task] Render task components by JSON. #11198
• [DSIP-16][Task] Support stream task #11352
• [DSIP-17][Feature][Registry] Support etcd as registry #8975
• [DSIP-18][Remote Logging] Add support for writing task logs to remote storage #13017
• [DSIP-19][Feature] Add connection center feature for DS #10283
• DSIP-20: Basic version of the dynamic task component (only implements a required field in a Shell component). #12526
• [DSIP-21][TaskPlugin] Unify the task spi about logic task and worker task  #14823
• [DSIP-22][TriggerPlugin] Introduce Trigger Plugin #15330
• [DSIP-23][TaskPlugin] Add Lifecycle method to TaskPlugin  #14877
• [DSIP-24][RemoteLogging] Add Azure Blob Storage RemoteLogHandler #15765
• [DSIP-25][Remote Logging] Split remote logging configuration #15774
• [DSIP-26][Audit log] Audit log improvement design #15423
• [DSIP-27] Deprecate write java code in JAVA task  #15819
• [DSIP-28] Donot scan whole project beans under classpath #15877
• [DSIP-29][Task] Deprecate DISPATCH status in task instance lifecycle #15882
• [DSIP-30][UI] Add a page "about Dolphinscheduler" #15875
• [DSIP-31] Reduce the connection pool size of hikari #15889
• [DSIP-32][Master] Add command fetcher strategy for master fetch command #15897
• [DSIP-33] Reduce WorkflowExecuteRunnable complexity #15901
• [DSIP-34] Change required_approving_review_count to 2 #15913
• [DSIP-35][Alert] Refactor the alert thread model #15931
• [DSIP-36][Dependency] Upgrading dependent component versions #15940
• [DSIP-37] Disable HTTP TRACE requests in jetty via configuration #15943
• [DSIP-38] Add plugins directory in binary package #15960
• [DSIP-39][parameter] Startup parameters/global parameters/project parameters support set data type #15936
• [DSIP-40][APIService] Add LogClient to fetch log  #15966
• [DSIP-41] Add workflow identify into taskDefinition metadata #16005
• [DSIP-42] Add dolphinscheduler-aws-authentication module  #16024
• [DSIP-43] Add the UGI authentication module #16025
• [DSIP-43] Unify index name in Mysql/PG #16048
• [DSIP-44] Add owner for provider managed plugins #16093
• [DSIP-45] Polish the Storage SPI #16140
• [DSIP-46] Unify the logic task params data structure between front-end and back-end #16153
• [DSIP-47] Support query runtime metrics(TaskInstance/WorkflowInstacne) by project #16157
• [DSIP-48][Cluster Task Insights] Add a series of monitoring indicators to reflect the running status of tasks #15921
• [DSIP-49][Workflow] Rerun across workflow or project with dependency automatically #16194
• [DSIP-53][Dependent] Suggest add process lineage parsing for dependent task #16255
• [DSIP-55][Master] Separate the waiting dispatched task into different queue by worker group #16260
• [DSIP-56] Refactor JDBC registry support session timeout and data change event #16278
• [DSIP-57][Audit] Refactor PR 14981 code #16367
• [DSIP-58][API] Refactor create/update process definition code #16393
• [DSIP-59] Suggest remove single task definition code and ui #16394
• [DSIP-60][Http task plugin] Refactor http task plugin #16404
• [DSIP-61][Master] Refactor thread pool and state event orchestration in master #16423
• [DSIP-62][Http Alert Plugin] Refactor http alert plugin #16469
• [DSIP-63][k8s] Support User-customized K8s YAML Task #16478
• [DSIP-64] Add more workflow Integration test cases in master. #16479
• [DSIP-65] SubWorkflow logic task support failover/repeat running/pause/kill/recover #16480
• [DSIP-66][k8s] YAML Pod for User Customization #16482
• [DSIP-67] Use command to trigger workflow instance rather generate workflow instance #16485
• [DSIP-68] Uniformly name process in code as workflow #16515
• [DSIP-69] Fix master dispatch task timeout might cause task duplicate running in worker #16481
• [DSIP-70] Deprecated upgrade code of 1.x and 2.x in 3.3.0-release #16543
• [DSIP-71] Dependent task support pause/recover #16577
• [DSIP-72][Dynamic Task] Suggest remove dynamic task type #16591
• [DSIP-73] Add dolphinscheduler-task-executor module to unify the task execution logic #16619
• [DSIP-74] Optimize workflow-related displays and filters #16631
• [DSIP-75] Support auto add license header by spotless #16642
• [DSIP-76][RPC] Support ssl at RPC  #16688
• [DSIP-77][task-api] Add cycle dependency type #16706
• [DSIP-78][Data Quality] Suggest remove data quality module #16728
• [DSIP-79][Task] Add Datavines task to better support data quality #16113
• [DSIP-80][Scheduler] Fix scheduler duplicate fired #16816
• [DSIP-81][Alert] Add Integration test for alert server. #16823
• [DSIP-82][Master/Worker] Use FAILOVER_FINISH_NODES to avoid duplicate workflow/task when failover #16825
• [DSIP-83][Feature] Add DolphinDB datasource support to DolphinScheduler #16818
• [DSIP-84][Feature] Add Caché datasource support to DolphinScheduler #16833