expression,planner/core: support unix_timestamp() function in partition pruning

[tiancaiamao]

What problem does this PR solve?

CREATE TABLE quarterly_report_status (
    report_id INT NOT NULL,
    report_status VARCHAR(20) NOT NULL,
    report_updated TIMESTAMP NOT NULL DEFAULT CURRENT_TIMESTAMP ON UPDATE CURRENT_TIMESTAMP) 
PARTITION BY RANGE (UNIX_TIMESTAMP(report_updated)) (
    PARTITION p0 VALUES LESS THAN (UNIX_TIMESTAMP('2008-01-01 00:00:00')),
    PARTITION p1 VALUES LESS THAN (UNIX_TIMESTAMP('2008-04-01 00:00:00')),
    PARTITION p2 VALUES LESS THAN (UNIX_TIMESTAMP('2010-01-01 00:00:00')),
    PARTITION p3 VALUES LESS THAN (MAXVALUE)
);

Expected:

mysql> explain select * from quarterly_report_status where report_updated < '2007-05-01 00:00:00';
+---------------------+----------+------+------------------------------------------------------------------------------------------------+
| id                  | count    | task | operator info                                                                                  |
+---------------------+----------+------+------------------------------------------------------------------------------------------------+
| TableReader_8       | 3323.33  | root | data:Selection_7                                                                               |
| └─Selection_7       | 3323.33  | cop  | lt(test.quarterly_report_status.report_updated, 2007-05-01 00:00:00.000000)                    |
|   └─TableScan_6     | 10000.00 | cop  | table:quarterly_report_status, partition:p0, range:[-inf,+inf], keep order:false, stats:pseudo |
+---------------------+----------+------+------------------------------------------------------------------------------------------------+
3 rows in set (0.00 sec)

Get:

mysql> explain select * from quarterly_report_status where report_updated < '2007-05-01 00:00:00';
+--------------------------+----------+------+------------------------------------------------------------------------------------------------+
| id                       | count    | task | operator info                                                                                  |
+--------------------------+----------+------+------------------------------------------------------------------------------------------------+
| Union_10                 | 13293.33 | root |                                                                                                |
| ├─TableReader_13         | 3323.33  | root | data:Selection_12                                                                              |
| │ └─Selection_12         | 3323.33  | cop  | lt(test.quarterly_report_status.report_updated, 2007-05-01 00:00:00.000000)                    |
| │   └─TableScan_11       | 10000.00 | cop  | table:quarterly_report_status, partition:p0, range:[-inf,+inf], keep order:false, stats:pseudo |
| ├─TableReader_16         | 3323.33  | root | data:Selection_15                                                                              |
| │ └─Selection_15         | 3323.33  | cop  | lt(test.quarterly_report_status.report_updated, 2007-05-01 00:00:00.000000)                    |
| │   └─TableScan_14       | 10000.00 | cop  | table:quarterly_report_status, partition:p1, range:[-inf,+inf], keep order:false, stats:pseudo |
| ├─TableReader_19         | 3323.33  | root | data:Selection_18                                                                              |
| │ └─Selection_18         | 3323.33  | cop  | lt(test.quarterly_report_status.report_updated, 2007-05-01 00:00:00.000000)                    |
| │   └─TableScan_17       | 10000.00 | cop  | table:quarterly_report_status, partition:p2, range:[-inf,+inf], keep order:false, stats:pseudo |
| └─TableReader_22         | 3323.33  | root | data:Selection_21                                                                              |
|   └─Selection_21         | 3323.33  | cop  | lt(test.quarterly_report_status.report_updated, 2007-05-01 00:00:00.000000)                    |
|     └─TableScan_20       | 10000.00 | cop  | table:quarterly_report_status, partition:p3, range:[-inf,+inf], keep order:false, stats:pseudo |
+--------------------------+----------+------+------------------------------------------------------------------------------------------------+
13 rows in set (0.00 sec)

Partition pruning doesn't work using the unix_timestamp() function.

What is changed and how it works?

Add unix_timestamp to monotoneIncFuncs list.
We can infer the rule f(x) > xxx and x < yyy if f is monotonously increasing.

Check List

Tests

• Unit test
• Manual test (add detailed scripts or steps below)

[codecov]

Codecov Report

Merging #12035 into master will not change coverage.
The diff coverage is n/a.

@@             Coverage Diff             @@
##             master     #12035   +/-   ##
===========================================
  Coverage   81.3689%   81.3689%           
===========================================
  Files           453        453           
  Lines         97289      97289           
===========================================
  Hits          79163      79163           
  Misses        12468      12468           
  Partials       5658       5658

[tiancaiamao]

PTAL @XuHuaiyu @eurekaka

[tiancaiamao]

Related issue #12028

[zimulala]

/run-common-test

[fatpa]

The arguments hh, min, ss dosen't use in the newTimeConst function, why still pass them into the function??

[tiancaiamao]

A timestamp value has the hh, min, ss part, while a date value contains only the yy, mm, dd information. That's why the newDate function has fewer parameters than newTimestamp.

We pass 0 as arguments, but it doesn't means hh, min, ss would never be useful in the future.
@fatpa

[tiancaiamao]

PTAL @XuHuaiyu @eurekaka @zz-jason

[eurekaka]

LGTM. Please fix CI.

[tiancaiamao]

/run-all-tests

[tiancaiamao]

/rebuild

[tiancaiamao]

/rebuild

[tiancaiamao]

/run-sqllogic-test-1

[tiancaiamao]

/run-integration-compatibility-test

[zz-jason]

LGTM

[sre-bot]

Your auto merge job has been accepted, waiting for 11702, 12150

[sre-bot]

/run-all-tests

[sre-bot]

@tiancaiamao merge failed.

[zz-jason]

/run-unit-test

[tiancaiamao]

/run-all-tests

[sre-bot]

cherry pick to release-3.0 failed

[cyliu0]

@tiancaiamao Do we need to cherry pick this one to release-3.1?

[sre-bot]

It seems that, not for sure, we failed to cherry-pick this commit to release-3.0. Please comment '/run-cherry-picker' to try to trigger the cherry-picker if we did fail to cherry-pick this commit before. @tiancaiamao PTAL.