Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[fix](fe) fix several blocking bugs #37756 #37758

Merged
merged 2 commits into from
Jul 14, 2024

Conversation

morningman
Copy link
Contributor

bp #37756

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@morningman
Copy link
Contributor Author

run buildall

@github-actions github-actions bot added the area/planner Issues or PRs related to the query planner label Jul 14, 2024
@doris-robot
Copy link

TPC-H: Total hot run time: 49637 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit d616efb63e3c3e727400aa3311bbb504ac423858, data reload: false

------ Round 1 ----------------------------------
q1	18028	4414	4337	4337
q2	2069	153	150	150
q3	10444	1871	1885	1871
q4	10337	1242	1282	1242
q5	9066	3909	3866	3866
q6	226	124	166	124
q7	2020	1601	1557	1557
q8	9390	2805	2706	2706
q9	10695	10388	10169	10169
q10	8639	3521	3491	3491
q11	431	239	248	239
q12	474	303	297	297
q13	18359	3978	3979	3978
q14	357	320	337	320
q15	502	462	461	461
q16	681	576	573	573
q17	1132	953	994	953
q18	7259	6840	6968	6840
q19	1812	1631	1611	1611
q20	516	297	298	297
q21	4441	4105	4137	4105
q22	551	450	457	450
Total cold run time: 117429 ms
Total hot run time: 49637 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4361	4364	4285	4285
q2	320	235	232	232
q3	4177	4129	4090	4090
q4	2748	2724	2744	2724
q5	7091	7092	7065	7065
q6	240	122	120	120
q7	3211	2849	2813	2813
q8	4358	4472	4483	4472
q9	16929	16689	16736	16689
q10	4218	4318	4310	4310
q11	775	743	694	694
q12	1037	871	871	871
q13	6855	3715	3708	3708
q14	455	429	429	429
q15	502	460	460	460
q16	748	690	674	674
q17	3831	3847	3805	3805
q18	8740	8703	8840	8703
q19	1714	1728	1677	1677
q20	2368	2111	2096	2096
q21	8490	8515	8522	8515
q22	1087	1005	1021	1005
Total cold run time: 84255 ms
Total hot run time: 79437 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 203450 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit d616efb63e3c3e727400aa3311bbb504ac423858, data reload: false

query1	934	426	377	377
query2	6554	2672	2832	2672
query3	6924	220	204	204
query4	21170	17868	17962	17868
query5	19732	6513	6567	6513
query6	289	219	226	219
query7	4160	295	302	295
query8	422	446	446	446
query9	3127	2678	2621	2621
query10	412	318	300	300
query11	11371	10597	10659	10597
query12	126	73	74	73
query13	5610	690	692	690
query14	17840	13147	13387	13147
query15	365	246	249	246
query16	6460	288	264	264
query17	1748	1445	911	911
query18	2277	417	411	411
query19	221	156	148	148
query20	81	78	80	78
query21	193	98	91	91
query22	5119	4992	4942	4942
query23	32501	31826	32103	31826
query24	6981	6492	6503	6492
query25	528	426	434	426
query26	528	165	160	160
query27	1854	302	297	297
query28	6175	2335	2300	2300
query29	2860	2639	2745	2639
query30	242	168	168	168
query31	906	734	748	734
query32	69	64	61	61
query33	409	256	263	256
query34	843	461	493	461
query35	1113	940	923	923
query36	1288	1093	1226	1093
query37	96	60	59	59
query38	3043	2937	2932	2932
query39	1376	1347	1321	1321
query40	207	98	96	96
query41	49	45	45	45
query42	87	86	84	84
query43	787	688	672	672
query44	1236	716	714	714
query45	248	234	240	234
query46	1223	966	967	966
query47	1895	1757	1710	1710
query48	1025	718	716	716
query49	634	401	376	376
query50	867	599	602	599
query51	4783	4684	4602	4602
query52	95	79	95	79
query53	441	333	326	326
query54	2684	2429	2449	2429
query55	94	83	83	83
query56	244	216	209	209
query57	1129	1099	1086	1086
query58	226	202	203	202
query59	4013	3893	3801	3801
query60	230	211	210	210
query61	95	93	115	93
query62	806	475	451	451
query63	484	344	340	340
query64	2597	1525	1378	1378
query65	3639	3532	3562	3532
query66	770	380	379	379
query67	17418	16268	15813	15813
query68	5718	646	635	635
query69	575	350	357	350
query70	1463	1569	1549	1549
query71	393	302	317	302
query72	6376	3524	3520	3520
query73	732	323	320	320
query74	6257	5754	5810	5754
query75	4401	3715	3880	3715
query76	2955	1184	1211	1184
query77	470	252	254	252
query78	12507	11748	11672	11672
query79	8218	655	627	627
query80	2800	406	402	402
query81	527	236	236	236
query82	1608	99	100	99
query83	256	139	135	135
query84	256	71	73	71
query85	1411	329	339	329
query86	376	295	285	285
query87	3239	3051	3024	3024
query88	5297	2351	2352	2351
query89	366	292	289	289
query90	1779	210	219	210
query91	182	153	147	147
query92	59	55	54	54
query93	3927	578	553	553
query94	868	215	208	208
query95	1107	1052	1064	1052
query96	645	335	335	335
query97	6592	6341	6413	6341
query98	182	169	171	169
query99	2958	794	842	794
Total cold run time: 308453 ms
Total hot run time: 203450 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.35 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit d616efb63e3c3e727400aa3311bbb504ac423858, data reload: false

query1	0.03	0.02	0.03
query2	0.06	0.03	0.02
query3	0.25	0.05	0.05
query4	1.80	0.07	0.06
query5	0.54	0.52	0.52
query6	1.23	0.60	0.60
query7	0.02	0.01	0.01
query8	0.03	0.02	0.03
query9	0.52	0.48	0.48
query10	0.54	0.53	0.52
query11	0.12	0.09	0.09
query12	0.12	0.09	0.09
query13	0.63	0.61	0.62
query14	0.79	0.76	0.79
query15	0.79	0.76	0.76
query16	0.40	0.38	0.36
query17	1.01	0.98	1.00
query18	0.22	0.25	0.22
query19	1.93	1.85	1.84
query20	0.01	0.02	0.01
query21	15.49	0.54	0.56
query22	2.28	1.87	1.63
query23	17.30	0.98	0.92
query24	7.38	1.04	0.70
query25	0.36	0.04	0.04
query26	0.83	0.16	0.16
query27	0.04	0.03	0.03
query28	6.31	0.78	0.74
query29	12.65	2.36	2.25
query30	0.60	0.53	0.53
query31	2.81	0.38	0.38
query32	3.37	0.49	0.50
query33	3.06	3.07	3.05
query34	15.24	4.75	4.77
query35	4.87	4.85	4.85
query36	1.06	1.01	1.02
query37	0.06	0.05	0.05
query38	0.03	0.03	0.02
query39	0.02	0.01	0.02
query40	0.16	0.14	0.14
query41	0.06	0.01	0.02
query42	0.02	0.01	0.01
query43	0.03	0.02	0.02
Total cold run time: 105.07 s
Total hot run time: 30.35 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit d616efb63e3c3e727400aa3311bbb504ac423858 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          59 seconds loaded 1101869774 Bytes, about 17 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       21.5 seconds inserted 10000000 Rows, about 465K ops/s

@morningman morningman merged commit 0bcc177 into apache:branch-2.0 Jul 14, 2024
24 of 25 checks passed
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/planner Issues or PRs related to the query planner
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants