[fix](dynamic partition) fix create dynamic partition with overlap not throw exception #37924

yujun777 · 2024-07-16T09:39:11Z

PR #35778 will throw exception if dynamic partition overlap with others. Don't throw exception due to considering no behaviour change. Just ignore create this partition.

SQL:

PARTITION BY RANGE(`dt`)(
PARTITION `phistory` VALUES less than ('2024-01-01')
)
DISTRIBUTED BY HASH(`user_id`, `room_id`) BUCKETS 3
PROPERTIES (
"replication_allocation" = "tag.location.default: 1",
"dynamic_partition.enable" = "true",
"dynamic_partition.time_unit" = "DAY",
"dynamic_partition.end" = "10",
"dynamic_partition.prefix" = "p",
"dynamic_partition.create_history_partition" = "true",
"dynamic_partition.history_partition_num" = "250"
);

error:

ERROR 1105 (HY000): errCode = 2, detailMessage = errCode = 2, detailMessage = errCode = 2, detailMessage = Range [types: [DATEV2]; keys: [0000-01-01]; ..types: [DATEV2]; keys: [2024-01-01]; ) is intersected with range: [types: [DATEV2]; keys: [2023-12-29]; ..types: [DATEV2]; keys: [2023-12-30]; )

doris-robot · 2024-07-16T09:39:15Z

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

yujun777 · 2024-07-16T09:39:25Z

run buildall

deardeng

LGTM

github-actions · 2024-07-16T09:55:56Z

PR approved by anyone and no changes requested.

doris-robot · 2024-07-16T10:50:23Z

TPC-H: Total hot run time: 39951 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit cd32364fb4cf4ce16e4812dfa287049f71b81ccd, data reload: false

------ Round 1 ----------------------------------
q1	17620	4399	4276	4276
q2	2014	192	193	192
q3	10439	1242	1120	1120
q4	10189	831	711	711
q5	7527	2731	2715	2715
q6	226	140	137	137
q7	961	590	596	590
q8	9210	2076	2102	2076
q9	8740	6607	6614	6607
q10	8823	3806	3813	3806
q11	440	240	234	234
q12	420	222	231	222
q13	17777	2967	3012	2967
q14	287	228	235	228
q15	523	479	485	479
q16	505	392	374	374
q17	978	666	703	666
q18	8129	7611	7396	7396
q19	3443	1422	1366	1366
q20	690	316	327	316
q21	5115	3284	3178	3178
q22	352	296	295	295
Total cold run time: 114408 ms
Total hot run time: 39951 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4321	4241	4238	4238
q2	374	270	270	270
q3	3019	2848	2887	2848
q4	1971	1743	1738	1738
q5	5628	5593	5574	5574
q6	232	142	136	136
q7	2146	1845	1919	1845
q8	3284	3446	3399	3399
q9	8843	8780	8867	8780
q10	4131	3905	3847	3847
q11	588	489	482	482
q12	794	658	681	658
q13	17108	3191	3155	3155
q14	311	305	301	301
q15	547	519	489	489
q16	486	431	436	431
q17	1822	1540	1532	1532
q18	8124	8099	7771	7771
q19	2748	1555	1546	1546
q20	2252	1862	1876	1862
q21	5135	4942	4732	4732
q22	609	506	513	506
Total cold run time: 74473 ms
Total hot run time: 56140 ms

doris-robot · 2024-07-16T11:01:58Z

TPC-DS: Total hot run time: 174284 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit cd32364fb4cf4ce16e4812dfa287049f71b81ccd, data reload: false

query1	909	377	368	368
query2	6441	1849	1819	1819
query3	6638	219	224	219
query4	28056	17792	17505	17505
query5	3693	490	475	475
query6	279	161	164	161
query7	4576	294	298	294
query8	245	192	191	191
query9	8589	2413	2389	2389
query10	425	287	268	268
query11	10576	10080	10115	10080
query12	116	84	82	82
query13	1626	365	361	361
query14	10272	7027	7955	7027
query15	217	167	162	162
query16	7713	317	302	302
query17	1366	565	537	537
query18	1870	290	287	287
query19	206	166	159	159
query20	94	86	87	86
query21	200	137	129	129
query22	4411	4413	4047	4047
query23	34372	33800	33822	33800
query24	11261	3033	2934	2934
query25	642	427	423	423
query26	1002	163	155	155
query27	2348	282	285	282
query28	6754	2073	2076	2073
query29	919	682	690	682
query30	254	160	161	160
query31	974	782	770	770
query32	100	57	61	57
query33	787	317	297	297
query34	996	529	498	498
query35	699	577	586	577
query36	1165	998	1015	998
query37	144	95	87	87
query38	3024	2896	2826	2826
query39	916	873	826	826
query40	202	125	127	125
query41	47	47	47	47
query42	116	104	101	101
query43	483	477	468	468
query44	1263	737	751	737
query45	208	162	166	162
query46	1124	746	722	722
query47	1870	1751	1829	1751
query48	363	299	303	299
query49	868	419	433	419
query50	784	394	397	394
query51	6913	6830	6772	6772
query52	108	97	98	97
query53	364	297	295	295
query54	898	454	457	454
query55	80	74	78	74
query56	303	285	288	285
query57	1116	1049	1075	1049
query58	267	270	298	270
query59	2792	2807	2515	2515
query60	325	292	302	292
query61	118	113	115	113
query62	796	665	656	656
query63	323	292	289	289
query64	9445	2203	7460	2203
query65	3141	3122	3117	3117
query66	746	334	324	324
query67	15835	15151	14979	14979
query68	8128	561	542	542
query69	694	516	393	393
query70	1237	1158	1087	1087
query71	525	283	294	283
query72	9344	5338	5985	5338
query73	782	334	328	328
query74	6236	5688	5754	5688
query75	5360	2710	2731	2710
query76	5105	954	933	933
query77	809	305	308	305
query78	9791	9219	9069	9069
query79	8506	526	532	526
query80	1268	481	479	479
query81	587	227	232	227
query82	772	132	135	132
query83	329	166	163	163
query84	281	84	84	84
query85	1413	311	298	298
query86	438	298	281	281
query87	3262	3131	3111	3111
query88	5233	2401	2389	2389
query89	492	385	381	381
query90	1906	190	191	190
query91	131	97	98	97
query92	58	51	48	48
query93	6374	518	506	506
query94	1120	211	208	208
query95	409	320	317	317
query96	609	279	275	275
query97	3208	3032	3073	3032
query98	214	202	194	194
query99	1527	1296	1268	1268
Total cold run time: 301921 ms
Total hot run time: 174284 ms

doris-robot · 2024-07-16T11:07:31Z

ClickBench: Total hot run time: 31.34 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit cd32364fb4cf4ce16e4812dfa287049f71b81ccd, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.06
query4	1.68	0.08	0.10
query5	0.50	0.49	0.50
query6	1.14	0.72	0.73
query7	0.02	0.01	0.01
query8	0.05	0.05	0.05
query9	0.55	0.49	0.50
query10	0.55	0.56	0.55
query11	0.16	0.11	0.11
query12	0.14	0.12	0.13
query13	0.60	0.59	0.59
query14	0.77	0.80	0.77
query15	0.84	0.82	0.82
query16	0.37	0.37	0.36
query17	1.00	0.94	0.99
query18	0.23	0.24	0.22
query19	1.75	1.72	1.72
query20	0.01	0.01	0.01
query21	15.40	0.73	0.65
query22	3.88	6.63	2.58
query23	18.33	1.41	1.24
query24	2.06	0.23	0.22
query25	0.15	0.08	0.09
query26	0.30	0.22	0.21
query27	0.46	0.23	0.23
query28	13.30	1.01	1.00
query29	12.59	3.34	3.34
query30	0.25	0.05	0.06
query31	2.87	0.40	0.39
query32	3.26	0.47	0.47
query33	2.88	2.88	2.88
query34	17.15	4.40	4.46
query35	4.44	4.51	4.39
query36	0.65	0.46	0.47
query37	0.18	0.16	0.16
query38	0.16	0.16	0.14
query39	0.04	0.03	0.04
query40	0.14	0.13	0.12
query41	0.09	0.05	0.04
query42	0.06	0.05	0.06
query43	0.04	0.05	0.04
Total cold run time: 109.38 s
Total hot run time: 31.34 s

dataroaring

LGTM

github-actions · 2024-07-16T12:59:01Z

PR approved by at least one committer and no changes requested.

yujun777 · 2024-07-16T14:50:39Z

run buildall

yujun777 · 2024-07-16T14:58:01Z

update

yujun777 · 2024-07-16T15:19:39Z

run buildall

doris-robot · 2024-07-16T15:36:54Z

TPC-H: Total hot run time: 39900 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4260d21f6d7c17250ece0b0c646bcd8f989fcb3a, data reload: false

------ Round 1 ----------------------------------
q1	17687	4390	4281	4281
q2	2016	187	190	187
q3	10534	1236	1102	1102
q4	10200	857	735	735
q5	7540	2672	2687	2672
q6	216	139	138	138
q7	953	591	601	591
q8	9220	2066	2094	2066
q9	8618	6542	6556	6542
q10	8851	3772	3763	3763
q11	458	242	232	232
q12	521	218	228	218
q13	17757	2972	2985	2972
q14	287	233	233	233
q15	537	477	481	477
q16	507	378	377	377
q17	961	720	679	679
q18	7964	7438	7452	7438
q19	8265	1456	1399	1399
q20	695	321	320	320
q21	4996	3198	3273	3198
q22	350	280	281	280
Total cold run time: 119133 ms
Total hot run time: 39900 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4402	4279	4236	4236
q2	365	278	274	274
q3	3059	2928	2975	2928
q4	1938	1730	1739	1730
q5	5581	5547	5474	5474
q6	229	135	143	135
q7	2271	1875	1852	1852
q8	3273	3420	3378	3378
q9	8762	8885	8753	8753
q10	4157	3771	3844	3771
q11	588	493	510	493
q12	815	680	624	624
q13	17299	3159	3205	3159
q14	318	277	298	277
q15	526	474	493	474
q16	509	437	444	437
q17	1806	1530	1525	1525
q18	7977	7943	7874	7874
q19	1738	1664	1448	1448
q20	2174	1865	1845	1845
q21	5032	4648	4825	4648
q22	559	513	505	505
Total cold run time: 73378 ms
Total hot run time: 55840 ms

doris-robot · 2024-07-16T15:48:09Z

TPC-DS: Total hot run time: 173509 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4260d21f6d7c17250ece0b0c646bcd8f989fcb3a, data reload: false

query1	914	359	368	359
query2	6416	1946	1866	1866
query3	6673	214	217	214
query4	28536	17433	17199	17199
query5	3655	480	470	470
query6	251	174	156	156
query7	4584	283	281	281
query8	232	196	187	187
query9	8442	2388	2381	2381
query10	443	315	277	277
query11	11734	10002	9945	9945
query12	117	87	84	84
query13	1646	363	371	363
query14	10124	7723	7524	7524
query15	224	164	168	164
query16	7221	316	303	303
query17	1827	550	524	524
query18	1769	271	271	271
query19	202	143	144	143
query20	92	79	81	79
query21	199	133	123	123
query22	4206	4113	3986	3986
query23	33983	33580	33615	33580
query24	10942	2849	2944	2849
query25	605	389	392	389
query26	714	161	145	145
query27	2244	279	280	279
query28	5895	2052	2083	2052
query29	889	617	651	617
query30	243	153	156	153
query31	1004	763	769	763
query32	103	54	56	54
query33	752	306	300	300
query34	1010	513	486	486
query35	694	578	557	557
query36	1145	969	1013	969
query37	134	81	87	81
query38	2962	2822	2829	2822
query39	896	836	856	836
query40	208	128	119	119
query41	53	44	45	44
query42	115	102	108	102
query43	530	465	458	458
query44	1226	735	714	714
query45	185	159	165	159
query46	1082	750	759	750
query47	1855	1780	1774	1774
query48	377	292	291	291
query49	832	398	420	398
query50	756	389	382	382
query51	6941	6878	6854	6854
query52	103	94	90	90
query53	361	291	287	287
query54	885	441	441	441
query55	73	74	73	73
query56	282	297	257	257
query57	1136	1056	1047	1047
query58	244	249	249	249
query59	2926	2768	2642	2642
query60	297	268	273	268
query61	94	91	96	91
query62	782	646	645	645
query63	321	285	290	285
query64	9163	2201	7477	2201
query65	3157	3118	3142	3118
query66	766	329	326	326
query67	15536	15188	14822	14822
query68	4450	536	539	536
query69	557	409	351	351
query70	1161	1149	1119	1119
query71	370	272	271	271
query72	7107	5509	5762	5509
query73	752	325	321	321
query74	6160	5696	5629	5629
query75	3368	2731	2717	2717
query76	2178	897	980	897
query77	452	309	298	298
query78	11697	9031	8992	8992
query79	3391	524	521	521
query80	1964	482	480	480
query81	586	219	227	219
query82	810	134	128	128
query83	300	183	177	177
query84	283	88	86	86
query85	998	364	296	296
query86	488	320	316	316
query87	3319	3108	3155	3108
query88	4340	2377	2375	2375
query89	509	403	386	386
query90	1830	195	192	192
query91	126	97	106	97
query92	58	54	49	49
query93	4884	516	500	500
query94	1204	214	214	214
query95	405	314	306	306
query96	603	272	278	272
query97	3218	3017	3010	3010
query98	224	207	192	192
query99	1577	1235	1227	1227
Total cold run time: 283377 ms
Total hot run time: 173509 ms

doris-robot · 2024-07-16T15:53:41Z

ClickBench: Total hot run time: 30.7 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4260d21f6d7c17250ece0b0c646bcd8f989fcb3a, data reload: false

query1	0.04	0.04	0.03
query2	0.07	0.03	0.04
query3	0.23	0.05	0.05
query4	1.67	0.09	0.10
query5	0.51	0.49	0.49
query6	1.14	0.73	0.73
query7	0.02	0.01	0.02
query8	0.05	0.04	0.05
query9	0.55	0.49	0.50
query10	0.54	0.53	0.54
query11	0.15	0.11	0.11
query12	0.15	0.13	0.12
query13	0.58	0.58	0.58
query14	0.75	0.78	0.78
query15	0.86	0.80	0.81
query16	0.34	0.36	0.35
query17	0.97	0.98	0.95
query18	0.23	0.21	0.22
query19	1.80	1.70	1.75
query20	0.01	0.01	0.01
query21	15.41	0.76	0.67
query22	4.01	7.00	2.01
query23	18.25	1.29	1.35
query24	2.17	0.23	0.23
query25	0.16	0.09	0.09
query26	0.30	0.22	0.22
query27	0.46	0.22	0.23
query28	13.18	1.03	0.99
query29	12.60	3.33	3.36
query30	0.26	0.06	0.06
query31	2.86	0.39	0.39
query32	3.27	0.47	0.46
query33	2.92	2.92	2.88
query34	17.21	4.36	4.38
query35	4.37	4.47	4.38
query36	0.66	0.46	0.47
query37	0.18	0.16	0.16
query38	0.15	0.15	0.15
query39	0.04	0.04	0.03
query40	0.15	0.12	0.11
query41	0.08	0.04	0.05
query42	0.05	0.05	0.04
query43	0.05	0.03	0.04
Total cold run time: 109.45 s
Total hot run time: 30.7 s

yujun777 · 2024-07-17T01:39:08Z

run p0

yujun777 · 2024-07-17T01:39:26Z

run cloud_p0

yujun777 · 2024-07-17T02:26:10Z

run p0

doris-robot · 2024-07-17T03:05:56Z

TPC-H: Total hot run time: 39779 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4260d21f6d7c17250ece0b0c646bcd8f989fcb3a, data reload: false

------ Round 1 ----------------------------------
q1	17634	4357	4246	4246
q2	2018	186	199	186
q3	10464	1183	1068	1068
q4	10188	816	783	783
q5	7536	2778	2628	2628
q6	222	140	140	140
q7	953	598	605	598
q8	9216	2055	2090	2055
q9	8813	6604	6573	6573
q10	8770	3782	3791	3782
q11	438	235	229	229
q12	418	223	221	221
q13	18932	3019	2994	2994
q14	291	243	233	233
q15	525	480	487	480
q16	497	384	376	376
q17	952	654	658	654
q18	8166	7476	7356	7356
q19	7638	1363	1425	1363
q20	690	345	346	345
q21	5124	3182	3319	3182
q22	351	287	297	287
Total cold run time: 119836 ms
Total hot run time: 39779 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4623	4345	4367	4345
q2	371	267	256	256
q3	3239	3064	3141	3064
q4	2000	1803	1818	1803
q5	5636	5603	5519	5519
q6	251	133	140	133
q7	2282	1883	1845	1845
q8	3265	3471	3378	3378
q9	8780	8824	8761	8761
q10	4158	3728	3858	3728
q11	586	485	509	485
q12	821	647	637	637
q13	17149	3142	3203	3142
q14	302	294	290	290
q15	531	492	478	478
q16	488	446	433	433
q17	1826	1507	1483	1483
q18	8155	8012	7770	7770
q19	1701	1561	1812	1561
q20	2133	1869	1859	1859
q21	8031	4933	4732	4732
q22	598	509	509	509
Total cold run time: 76926 ms
Total hot run time: 56211 ms

doris-robot · 2024-07-17T03:17:09Z

TPC-DS: Total hot run time: 173326 ms

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4260d21f6d7c17250ece0b0c646bcd8f989fcb3a, data reload: false

query1	918	373	362	362
query2	6983	1855	1863	1855
query3	6643	215	225	215
query4	28489	17607	17190	17190
query5	3608	472	472	472
query6	293	184	174	174
query7	4572	301	277	277
query8	237	195	185	185
query9	8528	2387	2368	2368
query10	433	309	275	275
query11	10517	9982	10040	9982
query12	115	86	84	84
query13	1636	377	377	377
query14	10452	7585	7633	7585
query15	234	166	168	166
query16	7746	325	312	312
query17	1787	561	517	517
query18	1903	280	272	272
query19	197	149	176	149
query20	88	83	79	79
query21	207	131	128	128
query22	4356	4084	4124	4084
query23	34154	33822	33760	33760
query24	10871	2945	2899	2899
query25	606	397	418	397
query26	701	152	150	150
query27	2253	284	279	279
query28	6665	2058	2072	2058
query29	907	658	622	622
query30	259	161	156	156
query31	969	736	777	736
query32	101	51	53	51
query33	792	298	292	292
query34	1091	490	502	490
query35	689	596	607	596
query36	1149	1009	1016	1009
query37	145	79	86	79
query38	2976	2911	2811	2811
query39	894	860	844	844
query40	203	115	121	115
query41	44	42	43	42
query42	118	95	94	94
query43	515	464	475	464
query44	1203	718	712	712
query45	195	163	160	160
query46	1091	728	726	726
query47	1836	1779	1789	1779
query48	371	282	289	282
query49	841	401	406	401
query50	784	382	391	382
query51	6868	6894	6799	6799
query52	107	97	86	86
query53	357	293	285	285
query54	891	439	443	439
query55	75	74	73	73
query56	281	262	279	262
query57	1167	1054	1025	1025
query58	247	237	252	237
query59	2889	2756	2700	2700
query60	303	287	274	274
query61	98	95	96	95
query62	823	637	646	637
query63	325	286	287	286
query64	9497	2228	1655	1655
query65	3183	3081	3088	3081
query66	753	364	333	333
query67	15604	14951	14810	14810
query68	5251	545	532	532
query69	618	440	349	349
query70	1176	1122	1165	1122
query71	470	270	268	268
query72	7222	5599	5640	5599
query73	774	327	330	327
query74	6164	5622	5652	5622
query75	3645	2673	2669	2669
query76	3171	919	889	889
query77	627	296	303	296
query78	10484	8963	9909	8963
query79	5122	518	520	518
query80	1597	469	474	469
query81	571	221	222	221
query82	1307	138	141	138
query83	293	174	165	165
query84	283	85	89	85
query85	1456	311	364	311
query86	336	337	321	321
query87	3252	3104	3145	3104
query88	4740	2350	2370	2350
query89	474	380	378	378
query90	1377	188	190	188
query91	127	100	100	100
query92	58	51	48	48
query93	4996	507	492	492
query94	582	213	212	212
query95	400	307	314	307
query96	604	268	268	268
query97	3218	3019	3023	3019
query98	223	203	196	196
query99	1576	1292	1229	1229
Total cold run time: 288027 ms
Total hot run time: 173326 ms

doris-robot · 2024-07-17T03:22:41Z

ClickBench: Total hot run time: 31.08 s

machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4260d21f6d7c17250ece0b0c646bcd8f989fcb3a, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.07	0.07
query5	0.49	0.49	0.48
query6	1.13	0.73	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.57	0.47	0.50
query10	0.54	0.54	0.53
query11	0.16	0.11	0.11
query12	0.14	0.11	0.12
query13	0.58	0.58	0.58
query14	0.77	0.79	0.76
query15	0.86	0.81	0.82
query16	0.37	0.37	0.37
query17	1.01	1.03	0.98
query18	0.23	0.23	0.22
query19	1.85	1.80	1.83
query20	0.01	0.01	0.01
query21	15.40	0.74	0.66
query22	4.33	6.57	2.41
query23	18.27	1.43	1.33
query24	2.05	0.26	0.21
query25	0.15	0.09	0.08
query26	0.29	0.21	0.21
query27	0.46	0.22	0.23
query28	13.33	1.02	1.00
query29	12.65	3.30	3.23
query30	0.26	0.06	0.06
query31	2.86	0.38	0.39
query32	3.34	0.48	0.48
query33	2.94	2.91	2.94
query34	16.92	4.32	4.38
query35	4.51	4.34	4.41
query36	0.65	0.47	0.49
query37	0.18	0.16	0.15
query38	0.15	0.14	0.14
query39	0.04	0.04	0.04
query40	0.15	0.13	0.12
query41	0.09	0.05	0.05
query42	0.06	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 109.92 s
Total hot run time: 31.08 s

yujun777 · 2024-07-17T04:06:48Z

run external

yujun777 · 2024-07-17T04:10:25Z

run cloud_p0

…t throw exception #37924 (#37966) cherry-pick: #37924

dataroaring

LGTM

github-actions · 2024-07-17T09:23:25Z

PR approved by at least one committer and no changes requested.

…t throw exception #37924 (#37964) cherry-pick: #37924

…t throw exception (#37924) PR #35778 will throw exception if dynamic partition overlap with others. Don't throw exception due to considering no behaviour change. Just ignore create this partition. SQL: ``` PARTITION BY RANGE(`dt`)( PARTITION `phistory` VALUES less than ('2024-01-01') ) DISTRIBUTED BY HASH(`user_id`, `room_id`) BUCKETS 3 PROPERTIES ( "replication_allocation" = "tag.location.default: 1", "dynamic_partition.enable" = "true", "dynamic_partition.time_unit" = "DAY", "dynamic_partition.end" = "10", "dynamic_partition.prefix" = "p", "dynamic_partition.create_history_partition" = "true", "dynamic_partition.history_partition_num" = "250" ); ``` error: ``` ERROR 1105 (HY000): errCode = 2, detailMessage = errCode = 2, detailMessage = errCode = 2, detailMessage = Range [types: [DATEV2]; keys: [0000-01-01]; ..types: [DATEV2]; keys: [2024-01-01]; ) is intersected with range: [types: [DATEV2]; keys: [2023-12-29]; ..types: [DATEV2]; keys: [2023-12-30]; ) ```

…t throw exception apache#37924 (apache#37966) cherry-pick: apache#37924

dataroaring added the dev/2.1.x label Jul 16, 2024

deardeng approved these changes Jul 16, 2024

View reviewed changes

github-actions bot added the reviewed label Jul 16, 2024

yiguolei added the usercase Important user case type label label Jul 16, 2024

dataroaring previously approved these changes Jul 16, 2024

View reviewed changes

github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 16, 2024

yujun777 dismissed dataroaring’s stale review via 1f640f1 July 16, 2024 14:38

github-actions bot removed the approved Indicates a PR has been approved by one committer. label Jul 16, 2024

yujun777 added 6 commits July 16, 2024 23:18

create dynamic partition with overlap not throw exception

b99a069

add test

65490de

update

e0eab3d

update

1fb394b

update

3542853

update

4260d21

yujun777 force-pushed the dynamic-partition-with-overlap-not-throw-exception branch from 5b1dea2 to 4260d21 Compare July 16, 2024 15:19

This was referenced Jul 17, 2024

[fix](dynamic partition) fix create dynamic partition with overlap not throw exception #37924 #37964

Merged

[fix](dynamic partition) fix create dynamic partition with overlap not throw exception #37924 #37966

Merged

dataroaring pushed a commit that referenced this pull request Jul 17, 2024

[fix](dynamic partition) fix create dynamic partition with overlap no…

79b4154

…t throw exception #37924 (#37966) cherry-pick: #37924

dataroaring added the dev/2.0.14-merged label Jul 17, 2024

dataroaring approved these changes Jul 17, 2024

View reviewed changes

dataroaring merged commit 9609b22 into apache:master Jul 17, 2024
26 of 27 checks passed

github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 17, 2024

dataroaring pushed a commit that referenced this pull request Jul 17, 2024

[fix](dynamic partition) fix create dynamic partition with overlap no…

7180290

…t throw exception #37924 (#37964) cherry-pick: #37924

dataroaring added dev/2.1.5-merged and removed dev/2.1.x labels Jul 17, 2024

dataroaring added the dev/3.0.1-merged label Aug 5, 2024

mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024

[fix](dynamic partition) fix create dynamic partition with overlap no…

c74a1aa

…t throw exception apache#37924 (apache#37966) cherry-pick: apache#37924

gavinchou mentioned this pull request Aug 19, 2024

Release Note 3.0.1 #39570

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[fix](dynamic partition) fix create dynamic partition with overlap not throw exception #37924

[fix](dynamic partition) fix create dynamic partition with overlap not throw exception #37924

yujun777 commented Jul 16, 2024 •

edited

Loading

doris-robot commented Jul 16, 2024

yujun777 commented Jul 16, 2024

deardeng left a comment

github-actions bot commented Jul 16, 2024

doris-robot commented Jul 16, 2024

doris-robot commented Jul 16, 2024

doris-robot commented Jul 16, 2024

dataroaring left a comment

github-actions bot commented Jul 16, 2024

yujun777 commented Jul 16, 2024

yujun777 commented Jul 16, 2024

yujun777 commented Jul 16, 2024

doris-robot commented Jul 16, 2024

doris-robot commented Jul 16, 2024

doris-robot commented Jul 16, 2024

yujun777 commented Jul 17, 2024

yujun777 commented Jul 17, 2024

yujun777 commented Jul 17, 2024

doris-robot commented Jul 17, 2024

doris-robot commented Jul 17, 2024

doris-robot commented Jul 17, 2024

yujun777 commented Jul 17, 2024

yujun777 commented Jul 17, 2024

dataroaring left a comment

github-actions bot commented Jul 17, 2024

[fix](dynamic partition) fix create dynamic partition with overlap not throw exception #37924

[fix](dynamic partition) fix create dynamic partition with overlap not throw exception #37924

Conversation

yujun777 commented Jul 16, 2024 • edited Loading

doris-robot commented Jul 16, 2024

yujun777 commented Jul 16, 2024

deardeng left a comment

Choose a reason for hiding this comment

github-actions bot commented Jul 16, 2024

doris-robot commented Jul 16, 2024

doris-robot commented Jul 16, 2024

doris-robot commented Jul 16, 2024

dataroaring left a comment

Choose a reason for hiding this comment

github-actions bot commented Jul 16, 2024

yujun777 commented Jul 16, 2024

yujun777 commented Jul 16, 2024

yujun777 commented Jul 16, 2024

doris-robot commented Jul 16, 2024

doris-robot commented Jul 16, 2024

doris-robot commented Jul 16, 2024

yujun777 commented Jul 17, 2024

yujun777 commented Jul 17, 2024

yujun777 commented Jul 17, 2024

doris-robot commented Jul 17, 2024

doris-robot commented Jul 17, 2024

doris-robot commented Jul 17, 2024

yujun777 commented Jul 17, 2024

yujun777 commented Jul 17, 2024

dataroaring left a comment

Choose a reason for hiding this comment

github-actions bot commented Jul 17, 2024

yujun777 commented Jul 16, 2024 •

edited

Loading