Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[cherry-pick](branch-3.0) Pick "[Feature](schema change) Support add column bitmap with default value bitmap_empty (#42331)" #42701

Merged
merged 2 commits into from
Nov 2, 2024

Conversation

Yukang-Lian
Copy link
Collaborator

Proposed changes

Pick #42331

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@Yukang-Lian
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40439 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 363f0de3254668320fd57c1e5e78d156c070704e, data reload: false

------ Round 1 ----------------------------------
q1	17596	7412	7306	7306
q2	2017	277	265	265
q3	12234	1270	1111	1111
q4	10568	748	682	682
q5	7735	2844	2777	2777
q6	237	145	144	144
q7	983	613	591	591
q8	9573	1916	1919	1916
q9	8092	6454	6368	6368
q10	6990	2282	2292	2282
q11	435	235	234	234
q12	419	210	206	206
q13	17773	2981	2946	2946
q14	228	208	227	208
q15	581	523	514	514
q16	690	604	591	591
q17	952	536	606	536
q18	7096	6548	6597	6548
q19	2364	1032	962	962
q20	460	200	195	195
q21	3919	3134	3064	3064
q22	1066	993	1004	993
Total cold run time: 112008 ms
Total hot run time: 40439 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7381	7224	7219	7219
q2	327	232	254	232
q3	3051	2912	2877	2877
q4	2036	1766	1738	1738
q5	5639	5696	5731	5696
q6	223	140	140	140
q7	2194	1754	1737	1737
q8	3341	3402	3405	3402
q9	8822	8780	8778	8778
q10	3560	3520	3520	3520
q11	565	477	478	477
q12	824	611	585	585
q13	16402	3186	3134	3134
q14	299	269	272	269
q15	578	531	511	511
q16	710	667	655	655
q17	1833	1612	1578	1578
q18	8123	7822	7455	7455
q19	1731	1497	1714	1497
q20	2107	1812	1845	1812
q21	5489	5295	5238	5238
q22	1113	1061	1015	1015
Total cold run time: 76348 ms
Total hot run time: 59565 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 190087 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 363f0de3254668320fd57c1e5e78d156c070704e, data reload: false

query1	836	401	409	401
query2	6261	2122	2052	2052
query3	8690	208	210	208
query4	34074	23582	23363	23363
query5	3669	449	416	416
query6	270	165	161	161
query7	4185	307	308	307
query8	298	231	233	231
query9	9493	2669	2661	2661
query10	467	261	253	253
query11	17710	15101	15102	15101
query12	151	104	97	97
query13	1522	407	407	407
query14	9153	7039	6969	6969
query15	230	169	176	169
query16	7883	505	502	502
query17	1547	569	592	569
query18	2057	335	326	326
query19	210	155	159	155
query20	122	117	116	116
query21	206	116	109	109
query22	4826	4426	4511	4426
query23	34552	34134	33874	33874
query24	11413	2845	2863	2845
query25	646	403	411	403
query26	1177	163	169	163
query27	2631	290	303	290
query28	7857	2488	2469	2469
query29	863	435	430	430
query30	253	154	157	154
query31	1009	792	788	788
query32	95	58	54	54
query33	754	285	282	282
query34	939	517	509	509
query35	893	700	695	695
query36	1075	934	951	934
query37	131	73	70	70
query38	4019	3910	3932	3910
query39	1505	1424	1438	1424
query40	200	106	101	101
query41	55	52	51	51
query42	117	107	107	107
query43	540	496	486	486
query44	1266	802	795	795
query45	187	170	173	170
query46	1140	737	735	735
query47	1935	1891	1841	1841
query48	461	371	407	371
query49	946	402	416	402
query50	808	404	413	404
query51	7111	6952	6858	6858
query52	104	90	95	90
query53	250	192	181	181
query54	1125	470	440	440
query55	74	74	74	74
query56	247	238	236	236
query57	1210	1135	1070	1070
query58	224	191	216	191
query59	3062	2996	2782	2782
query60	265	247	245	245
query61	109	100	100	100
query62	866	679	675	675
query63	218	189	177	177
query64	4063	616	590	590
query65	3239	3159	3158	3158
query66	912	305	301	301
query67	16016	15279	15193	15193
query68	4560	546	542	542
query69	426	251	249	249
query70	1141	1092	1149	1092
query71	429	262	267	262
query72	6623	3971	3896	3896
query73	747	343	340	340
query74	10217	9023	8928	8928
query75	3338	2613	2605	2605
query76	2465	1060	1000	1000
query77	378	267	263	263
query78	10640	9644	9438	9438
query79	9169	594	590	590
query80	2260	417	439	417
query81	587	241	239	239
query82	1442	113	115	113
query83	261	136	136	136
query84	298	83	82	82
query85	2123	303	283	283
query86	472	293	292	292
query87	4503	4269	4253	4253
query88	5903	2384	2385	2384
query89	572	286	290	286
query90	2107	185	180	180
query91	175	142	139	139
query92	63	50	47	47
query93	8052	522	518	518
query94	951	285	280	280
query95	349	242	252	242
query96	639	281	281	281
query97	3336	3126	3170	3126
query98	209	203	194	194
query99	1698	1273	1278	1273
Total cold run time: 316555 ms
Total hot run time: 190087 ms

@gavinchou
Copy link
Contributor

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40637 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 363f0de3254668320fd57c1e5e78d156c070704e, data reload: false

------ Round 1 ----------------------------------
q1	17726	7423	7260	7260
q2	2045	155	180	155
q3	10678	1081	1167	1081
q4	10555	768	695	695
q5	7766	2822	2798	2798
q6	240	147	144	144
q7	984	614	612	612
q8	9361	1976	2005	1976
q9	6574	6447	6425	6425
q10	6990	2252	2344	2252
q11	437	245	243	243
q12	406	226	206	206
q13	17799	2982	2958	2958
q14	243	210	211	210
q15	572	518	518	518
q16	676	605	614	605
q17	974	665	579	579
q18	7207	6655	6605	6605
q19	3172	1064	1082	1064
q20	477	197	190	190
q21	4032	3087	3113	3087
q22	1054	974	1005	974
Total cold run time: 109968 ms
Total hot run time: 40637 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7415	7285	7274	7274
q2	324	235	233	233
q3	2999	2946	2858	2858
q4	2035	1729	1737	1729
q5	5692	5701	5728	5701
q6	228	138	143	138
q7	2178	1758	1738	1738
q8	3312	3563	3460	3460
q9	8864	8898	8863	8863
q10	3554	3475	3485	3475
q11	581	487	480	480
q12	840	642	569	569
q13	16615	3123	3133	3123
q14	297	268	273	268
q15	570	510	518	510
q16	694	672	673	672
q17	1871	1609	1595	1595
q18	8222	7820	7456	7456
q19	1731	1613	1548	1548
q20	2110	1832	1861	1832
q21	5335	5324	5273	5273
q22	1117	985	1038	985
Total cold run time: 76584 ms
Total hot run time: 59780 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193535 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 363f0de3254668320fd57c1e5e78d156c070704e, data reload: false

query1	1204	921	959	921
query2	6257	2074	2008	2008
query3	10786	3948	3790	3790
query4	68388	29599	23219	23219
query5	5655	436	411	411
query6	446	172	177	172
query7	6271	318	305	305
query8	336	239	236	236
query9	9365	2676	2638	2638
query10	514	255	256	255
query11	18056	15362	15620	15362
query12	172	106	106	106
query13	1565	437	425	425
query14	11518	7151	7107	7107
query15	213	171	172	171
query16	7241	426	484	426
query17	1047	556	551	551
query18	1849	298	301	298
query19	192	151	147	147
query20	116	115	113	113
query21	213	101	100	100
query22	4530	4011	3953	3953
query23	33842	33906	33800	33800
query24	5708	2874	2873	2873
query25	515	406	409	406
query26	684	160	163	160
query27	1710	294	299	294
query28	4388	2564	2515	2515
query29	672	428	432	428
query30	235	158	156	156
query31	1012	767	803	767
query32	65	58	56	56
query33	461	278	272	272
query34	898	495	507	495
query35	809	721	737	721
query36	1072	935	930	930
query37	117	72	77	72
query38	3942	3830	3818	3818
query39	1494	1450	1431	1431
query40	195	97	98	97
query41	50	52	46	46
query42	107	96	96	96
query43	527	473	490	473
query44	1148	790	806	790
query45	186	166	163	163
query46	1124	719	721	719
query47	1896	1822	1814	1814
query48	459	366	368	366
query49	765	403	384	384
query50	814	404	411	404
query51	7080	6916	6712	6712
query52	106	100	97	97
query53	266	184	185	184
query54	559	477	437	437
query55	78	79	75	75
query56	237	225	233	225
query57	1183	1082	1096	1082
query58	198	196	198	196
query59	3134	2911	2876	2876
query60	272	257	252	252
query61	113	136	98	98
query62	783	651	682	651
query63	206	192	187	187
query64	1671	607	576	576
query65	3259	3137	3204	3137
query66	727	324	303	303
query67	15869	15309	15215	15215
query68	4537	540	570	540
query69	419	248	247	247
query70	1190	1154	1154	1154
query71	411	258	255	255
query72	6400	4048	3936	3936
query73	758	344	334	334
query74	10276	8890	8918	8890
query75	3355	2649	2653	2649
query76	2037	983	945	945
query77	477	265	261	261
query78	10719	9742	9566	9566
query79	8667	587	603	587
query80	2020	401	424	401
query81	557	236	240	236
query82	1430	115	112	112
query83	252	128	130	128
query84	290	72	76	72
query85	1751	289	276	276
query86	468	308	256	256
query87	4412	4219	4215	4215
query88	5370	2328	2359	2328
query89	564	292	285	285
query90	2091	176	176	176
query91	169	138	137	137
query92	58	45	46	45
query93	6785	538	540	538
query94	879	288	292	288
query95	339	247	250	247
query96	617	271	286	271
query97	3352	3142	3165	3142
query98	208	200	189	189
query99	1943	1266	1293	1266
Total cold run time: 339371 ms
Total hot run time: 193535 ms

@Yukang-Lian
Copy link
Collaborator Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 40311 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 60707f8fe321887336bab6f6451e1ef753dd7dd7, data reload: false

------ Round 1 ----------------------------------
q1	17572	7390	7239	7239
q2	2054	154	146	146
q3	10722	1446	1127	1127
q4	10565	756	691	691
q5	7730	2798	2765	2765
q6	230	149	144	144
q7	973	620	599	599
q8	9554	1896	1989	1896
q9	8034	6359	6357	6357
q10	6957	2269	2280	2269
q11	464	260	256	256
q12	400	214	208	208
q13	17785	2942	2912	2912
q14	250	214	219	214
q15	567	506	507	506
q16	682	602	601	601
q17	964	572	555	555
q18	7191	6608	6573	6573
q19	1370	1054	1011	1011
q20	459	191	201	191
q21	3827	3266	3071	3071
q22	1083	1014	980	980
Total cold run time: 109433 ms
Total hot run time: 40311 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7258	7150	7264	7150
q2	330	234	227	227
q3	2852	2854	2851	2851
q4	1994	1800	1791	1791
q5	5622	5622	5693	5622
q6	225	141	147	141
q7	2185	1801	1760	1760
q8	3269	3515	3440	3440
q9	8714	8780	8774	8774
q10	3499	3464	3492	3464
q11	597	489	506	489
q12	808	588	599	588
q13	16437	3147	3057	3057
q14	313	280	266	266
q15	551	518	516	516
q16	707	667	654	654
q17	1844	1613	1570	1570
q18	8170	7814	7450	7450
q19	4079	1633	1519	1519
q20	2085	1826	1832	1826
q21	5356	5304	5258	5258
q22	1125	1023	1001	1001
Total cold run time: 78020 ms
Total hot run time: 59414 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 193981 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 60707f8fe321887336bab6f6451e1ef753dd7dd7, data reload: false

query1	1211	920	910	910
query2	6268	2041	1985	1985
query3	10755	3838	3944	3838
query4	68424	28222	23461	23461
query5	5459	456	416	416
query6	468	172	166	166
query7	6213	305	295	295
query8	342	227	226	226
query9	9627	2671	2632	2632
query10	483	252	246	246
query11	17971	15450	15587	15450
query12	165	103	106	103
query13	1585	434	412	412
query14	10986	6866	7166	6866
query15	212	175	167	167
query16	7066	490	490	490
query17	1077	547	552	547
query18	1664	298	295	295
query19	194	149	150	149
query20	117	110	107	107
query21	205	98	100	98
query22	4767	4535	4368	4368
query23	34287	33729	33634	33634
query24	5675	2799	2807	2799
query25	507	403	406	403
query26	676	161	167	161
query27	1680	287	289	287
query28	4210	2525	2486	2486
query29	671	434	430	430
query30	234	153	152	152
query31	993	793	815	793
query32	63	56	55	55
query33	457	286	275	275
query34	889	502	486	486
query35	841	739	709	709
query36	1062	922	937	922
query37	121	72	72	72
query38	3963	3912	3880	3880
query39	1507	1425	1433	1425
query40	200	98	96	96
query41	52	52	49	49
query42	106	97	97	97
query43	534	486	482	482
query44	1126	773	791	773
query45	182	163	163	163
query46	1119	692	702	692
query47	1943	1816	1840	1816
query48	451	362	373	362
query49	746	395	390	390
query50	820	414	400	400
query51	7154	7126	7096	7096
query52	109	92	89	89
query53	252	181	183	181
query54	542	445	432	432
query55	73	77	74	74
query56	251	235	227	227
query57	1189	1093	1113	1093
query58	199	209	202	202
query59	3061	2867	2819	2819
query60	261	255	247	247
query61	101	102	94	94
query62	764	651	671	651
query63	204	182	178	178
query64	1426	608	601	601
query65	3257	3113	3149	3113
query66	705	310	296	296
query67	15907	15351	15353	15351
query68	4551	546	546	546
query69	455	248	250	248
query70	1153	1137	1117	1117
query71	420	247	252	247
query72	6425	3848	3919	3848
query73	758	330	346	330
query74	10121	8789	8910	8789
query75	3328	2632	2613	2613
query76	2203	949	913	913
query77	504	258	256	256
query78	10660	9791	9551	9551
query79	8463	583	578	578
query80	1731	404	427	404
query81	542	246	238	238
query82	1306	114	116	114
query83	246	134	135	134
query84	284	76	70	70
query85	1583	288	276	276
query86	450	290	285	285
query87	4404	4139	4241	4139
query88	5499	2458	2458	2458
query89	539	296	291	291
query90	2158	190	184	184
query91	178	139	140	139
query92	65	48	47	47
query93	6490	545	537	537
query94	859	285	288	285
query95	351	243	252	243
query96	622	282	282	282
query97	3319	3152	3084	3084
query98	209	199	192	192
query99	1710	1296	1283	1283
Total cold run time: 337415 ms
Total hot run time: 193981 ms

@dataroaring dataroaring merged commit e46149b into apache:branch-3.0 Nov 2, 2024
21 of 23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants