Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[opt](inverted index) mow supports index optimization #37428

Merged
merged 1 commit into from
Jul 16, 2024
Merged

[opt](inverted index) mow supports index optimization #37428

merged 1 commit into from
Jul 16, 2024

Conversation

zzzxl1993
Copy link
Contributor

@zzzxl1993 zzzxl1993 commented Jul 8, 2024 •
edited
Loading

Proposed changes

  1. mow support no need_read_data opt.
  2. mow support topn opt.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jul 8, 2024

clang-tidy review says "All clean, LGTM! 👍"

xiaokang
xiaokang reviewed Jul 8, 2024
View reviewed changes
Copy link
Contributor

@xiaokang xiaokang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pls add testcase

be/src/olap/rowset/segment_v2/segment_iterator.cpp
@@ -2233,7 +2233,11 @@ Status SegmentIterator::_read_columns_by_rowids(std::vector<ColumnId>& read_colu
}

for (auto cid : read_column_ids) {
if (_prune_column(cid, (*mutable_columns)[cid], true, select_size)) {
auto& colunm = (*mutable_columns)[cid];
if (_no_need_read_key_data(cid, colunm, select_size)) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you call _no_need_read_key_data inside _prune_column?

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Jul 8, 2024

clang-tidy review says "All clean, LGTM! 👍"

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@zzzxl1993
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39920 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 43e6ad1419506107aa8d65a62989c5f9a24d5a0a, data reload: false

------ Round 1 ----------------------------------
q1	17618	4368	4265	4265
q2	2005	187	186	186
q3	10458	1210	1144	1144
q4	10198	823	851	823
q5	7609	2704	2745	2704
q6	216	138	140	138
q7	961	601	594	594
q8	9211	2052	2084	2052
q9	8930	6546	6541	6541
q10	8767	3802	3777	3777
q11	477	233	242	233
q12	444	231	228	228
q13	17781	2970	3016	2970
q14	281	235	240	235
q15	525	476	499	476
q16	502	384	384	384
q17	966	637	734	637
q18	7946	7386	7328	7328
q19	5590	1362	1402	1362
q20	664	315	314	314
q21	4834	3274	3245	3245
q22	354	284	302	284
Total cold run time: 116337 ms
Total hot run time: 39920 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4350	4214	4246	4214
q2	370	280	276	276
q3	3000	2807	2906	2807
q4	2012	1680	1661	1661
q5	5629	5595	5500	5500
q6	241	133	135	133
q7	2180	1822	1894	1822
q8	3252	3401	3365	3365
q9	8821	8713	8881	8713
q10	4124	3879	3776	3776
q11	612	479	504	479
q12	795	644	632	632
q13	17196	3201	3198	3198
q14	318	288	281	281
q15	533	480	499	480
q16	516	430	456	430
q17	1811	1548	1502	1502
q18	8106	8081	7822	7822
q19	1747	1688	1525	1525
q20	2209	1881	1851	1851
q21	5269	4869	4756	4756
q22	559	516	516	516
Total cold run time: 73650 ms
Total hot run time: 55739 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 172931 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 43e6ad1419506107aa8d65a62989c5f9a24d5a0a, data reload: false

query1	917	368	362	362
query2	6437	1932	1835	1835
query3	6630	205	216	205
query4	25978	17671	17370	17370
query5	3666	492	501	492
query6	264	189	157	157
query7	4588	292	285	285
query8	247	194	192	192
query9	8641	2369	2356	2356
query10	436	287	274	274
query11	10493	10068	10053	10053
query12	115	83	104	83
query13	1633	367	358	358
query14	9984	7626	7342	7342
query15	218	161	165	161
query16	7660	296	305	296
query17	1556	564	514	514
query18	1726	276	272	272
query19	185	146	147	146
query20	87	78	79	78
query21	203	124	119	119
query22	4269	4065	3967	3967
query23	33889	33749	33417	33417
query24	11323	2997	2890	2890
query25	627	401	412	401
query26	1073	144	148	144
query27	3001	276	268	268
query28	7279	2018	2018	2018
query29	890	653	616	616
query30	264	166	168	166
query31	969	746	743	743
query32	98	52	55	52
query33	757	289	322	289
query34	1008	516	490	490
query35	686	608	586	586
query36	1111	985	1001	985
query37	159	83	83	83
query38	2934	2860	2855	2855
query39	900	863	858	858
query40	208	124	119	119
query41	47	46	42	42
query42	106	97	97	97
query43	508	478	461	461
query44	1229	730	750	730
query45	192	158	164	158
query46	1085	695	715	695
query47	1856	1747	1761	1747
query48	366	289	290	289
query49	838	412	409	409
query50	786	409	397	397
query51	6940	6712	6757	6712
query52	105	98	89	89
query53	356	287	287	287
query54	878	453	443	443
query55	76	74	74	74
query56	280	301	271	271
query57	1137	1027	1034	1027
query58	260	236	250	236
query59	2820	2628	2569	2569
query60	289	266	277	266
query61	95	93	94	93
query62	798	637	664	637
query63	314	277	291	277
query64	9422	2194	1720	1720
query65	3178	3098	3093	3093
query66	761	333	351	333
query67	15316	14923	14803	14803
query68	5650	542	524	524
query69	642	410	342	342
query70	1176	1106	1067	1067
query71	471	275	277	275
query72	7563	5897	5920	5897
query73	775	322	323	322
query74	5972	5553	5514	5514
query75	3690	2651	2674	2651
query76	3552	978	1003	978
query77	642	298	295	295
query78	9559	8978	9004	8978
query79	2353	516	508	508
query80	2255	481	466	466
query81	599	225	221	221
query82	1434	132	133	132
query83	294	162	166	162
query84	271	91	85	85
query85	1510	308	298	298
query86	470	322	299	299
query87	3273	3156	3159	3156
query88	3459	2443	2479	2443
query89	477	380	388	380
query90	1792	195	195	195
query91	202	102	98	98
query92	65	48	47	47
query93	2208	498	491	491
query94	1086	220	214	214
query95	398	326	317	317
query96	614	273	273	273
query97	3183	3068	3030	3030
query98	217	198	192	192
query99	1620	1265	1229	1229
Total cold run time: 280619 ms
Total hot run time: 172931 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.31 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 43e6ad1419506107aa8d65a62989c5f9a24d5a0a, data reload: false

query1	0.04	0.04	0.03
query2	0.08	0.04	0.04
query3	0.22	0.04	0.05
query4	1.69	0.08	0.07
query5	0.50	0.48	0.49
query6	1.14	0.73	0.72
query7	0.02	0.02	0.01
query8	0.05	0.05	0.04
query9	0.55	0.50	0.48
query10	0.56	0.55	0.55
query11	0.14	0.12	0.11
query12	0.14	0.12	0.13
query13	0.58	0.58	0.57
query14	0.75	0.79	0.78
query15	0.85	0.83	0.81
query16	0.37	0.37	0.38
query17	1.04	1.05	1.01
query18	0.22	0.22	0.21
query19	1.88	1.73	1.70
query20	0.01	0.01	0.01
query21	15.40	0.73	0.64
query22	4.52	6.83	1.75
query23	18.28	1.40	1.22
query24	2.06	0.21	0.22
query25	0.16	0.08	0.08
query26	0.29	0.22	0.19
query27	0.46	0.23	0.22
query28	13.40	1.01	0.98
query29	12.63	3.32	3.30
query30	0.25	0.06	0.05
query31	2.89	0.40	0.38
query32	3.26	0.46	0.46
query33	2.92	2.92	2.95
query34	17.02	4.33	4.31
query35	4.39	4.44	4.38
query36	0.64	0.49	0.48
query37	0.20	0.16	0.15
query38	0.16	0.15	0.16
query39	0.05	0.04	0.04
query40	0.16	0.11	0.12
query41	0.09	0.05	0.05
query42	0.05	0.06	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.16 s
Total hot run time: 30.31 s

@zzzxl1993
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 39748 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 167d779f125ff14b43a5150d56dffd4c995309fd, data reload: false

------ Round 1 ----------------------------------
q1	17611	4296	4308	4296
q2	2021	192	182	182
q3	10458	1141	1072	1072
q4	10202	732	865	732
q5	7552	2670	2621	2621
q6	218	138	137	137
q7	942	590	605	590
q8	9216	2064	2050	2050
q9	8077	6543	6582	6543
q10	8709	3774	3821	3774
q11	463	245	232	232
q12	390	238	235	235
q13	18963	2999	3005	2999
q14	276	241	244	241
q15	534	490	490	490
q16	506	383	385	383
q17	959	614	599	599
q18	8114	7439	7466	7439
q19	5858	1437	1352	1352
q20	670	323	326	323
q21	4959	3174	3260	3174
q22	353	287	284	284
Total cold run time: 117051 ms
Total hot run time: 39748 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4463	4561	4279	4279
q2	369	284	277	277
q3	3052	2891	2922	2891
q4	2090	1746	1727	1727
q5	5708	5603	5503	5503
q6	221	136	141	136
q7	2226	1912	1857	1857
q8	3355	3503	3494	3494
q9	9056	9007	9167	9007
q10	4269	4155	4035	4035
q11	587	497	526	497
q12	860	692	710	692
q13	17249	3200	3261	3200
q14	310	295	317	295
q15	542	484	499	484
q16	488	435	448	435
q17	1854	1529	1525	1525
q18	8241	7989	7830	7830
q19	1699	1516	1543	1516
q20	2205	1890	1896	1890
q21	9083	4917	4721	4721
q22	616	509	498	498
Total cold run time: 78543 ms
Total hot run time: 56789 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 173776 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 167d779f125ff14b43a5150d56dffd4c995309fd, data reload: false

query1	924	368	365	365
query2	6448	1869	1837	1837
query3	6640	208	217	208
query4	28211	17458	17153	17153
query5	3756	497	482	482
query6	270	184	171	171
query7	4591	301	285	285
query8	251	204	202	202
query9	8593	2389	2367	2367
query10	448	291	286	286
query11	12635	10041	10201	10041
query12	116	90	85	85
query13	1637	382	377	377
query14	10258	7937	7745	7745
query15	246	167	168	167
query16	7898	310	307	307
query17	1828	544	511	511
query18	1930	290	272	272
query19	195	150	149	149
query20	88	84	84	84
query21	210	129	119	119
query22	4428	4216	4016	4016
query23	34016	33766	34035	33766
query24	11082	2892	2881	2881
query25	597	413	392	392
query26	879	158	155	155
query27	2384	284	283	283
query28	6958	2046	2033	2033
query29	866	657	663	657
query30	253	151	149	149
query31	949	760	777	760
query32	94	53	62	53
query33	756	300	297	297
query34	999	500	499	499
query35	701	581	594	581
query36	1166	1013	994	994
query37	150	83	87	83
query38	2983	2809	2814	2809
query39	910	800	818	800
query40	207	129	118	118
query41	49	45	70	45
query42	123	101	101	101
query43	507	469	490	469
query44	1184	728	724	724
query45	194	158	162	158
query46	1083	726	723	723
query47	1855	1785	1771	1771
query48	375	313	306	306
query49	840	417	417	417
query50	789	391	394	391
query51	6895	6893	6728	6728
query52	107	100	93	93
query53	361	289	285	285
query54	868	449	446	446
query55	79	73	73	73
query56	285	268	268	268
query57	1159	1057	1075	1057
query58	258	262	283	262
query59	2851	2588	2639	2588
query60	323	280	286	280
query61	97	132	95	95
query62	824	636	658	636
query63	317	294	290	290
query64	9248	2234	1687	1687
query65	3155	3127	3114	3114
query66	751	330	339	330
query67	15228	15072	15070	15070
query68	4479	543	543	543
query69	471	328	342	328
query70	1220	1081	1189	1081
query71	408	291	288	288
query72	6950	5322	6174	5322
query73	747	327	338	327
query74	5926	5588	5562	5562
query75	3392	2759	2704	2704
query76	2427	915	899	899
query77	479	322	310	310
query78	9849	9070	9122	9070
query79	2749	520	532	520
query80	1997	494	487	487
query81	593	223	222	222
query82	938	141	136	136
query83	323	168	173	168
query84	277	90	87	87
query85	1767	320	334	320
query86	459	324	343	324
query87	3312	3135	3119	3119
query88	4658	2471	2485	2471
query89	472	405	401	401
query90	1743	205	200	200
query91	131	103	103	103
query92	63	52	55	52
query93	3773	505	505	505
query94	1059	225	224	224
query95	421	338	346	338
query96	622	284	276	276
query97	3225	3039	2998	2998
query98	224	212	205	205
query99	1715	1258	1240	1240
Total cold run time: 284225 ms
Total hot run time: 173776 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.53 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 167d779f125ff14b43a5150d56dffd4c995309fd, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.08	0.07
query5	0.51	0.49	0.50
query6	1.14	0.72	0.72
query7	0.02	0.02	0.02
query8	0.06	0.04	0.04
query9	0.57	0.50	0.50
query10	0.54	0.55	0.54
query11	0.14	0.11	0.11
query12	0.14	0.12	0.12
query13	0.60	0.60	0.59
query14	0.76	0.78	0.82
query15	0.84	0.81	0.82
query16	0.36	0.37	0.36
query17	1.02	1.03	1.00
query18	0.23	0.23	0.22
query19	1.81	1.75	1.70
query20	0.01	0.02	0.02
query21	15.38	0.76	0.66
query22	3.78	6.89	2.70
query23	18.25	1.31	1.29
query24	2.10	0.22	0.22
query25	0.17	0.09	0.08
query26	0.28	0.21	0.20
query27	0.46	0.23	0.23
query28	13.29	1.02	0.99
query29	12.63	3.28	3.27
query30	0.25	0.08	0.05
query31	2.87	0.38	0.40
query32	3.27	0.48	0.48
query33	2.93	2.92	2.92
query34	17.06	4.35	4.40
query35	4.41	4.47	4.45
query36	0.64	0.48	0.47
query37	0.18	0.16	0.16
query38	0.16	0.14	0.14
query39	0.05	0.03	0.04
query40	0.15	0.12	0.12
query41	0.09	0.05	0.05
query42	0.05	0.06	0.04
query43	0.05	0.04	0.04
Total cold run time: 109.27 s
Total hot run time: 31.53 s

xiaokang
xiaokang reviewed Jul 15, 2024
View reviewed changes
be/src/olap/rowset/segment_v2/segment_iterator.cpp Outdated
@@ -2892,11 +2919,24 @@ bool SegmentIterator::_can_opt_topn_reads() const {
return false;
}

if (!_col_predicates.empty() || !_col_preds_except_leafnode_of_andnode.empty()) {
if (!_common_expr_ctxs_push_down.empty() || !_remaining_conjunct_roots.empty()) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is the modifications in _can_opt_topn_reads related to mow need_read_key_data?

@xiaokang xiaokang added the doing label Jul 15, 2024
airborne12
airborne12 previously approved these changes Jul 15, 2024
View reviewed changes
Copy link
Member

@airborne12 airborne12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 15, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@zzzxl1993 zzzxl1993 changed the title [opt](inverted index) mow support need_read_key_data [opt](inverted index) mow supports index optimization Jul 15, 2024
@zzzxl1993
Copy link
Contributor Author

run p0

@zzzxl1993
Copy link
Contributor Author

run p0

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

1 similar comment
@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@zzzxl1993
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 40373 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 28c01f30377203a58e7f78b08325b43eeba9964a, data reload: false

------ Round 1 ----------------------------------
q1	17621	4375	4276	4276
q2	2017	191	188	188
q3	10500	1270	1218	1218
q4	10278	816	901	816
q5	7659	2751	2731	2731
q6	220	143	144	143
q7	988	614	612	612
q8	9330	2119	2152	2119
q9	9258	6661	6647	6647
q10	9118	3762	3797	3762
q11	470	229	240	229
q12	394	233	221	221
q13	17777	2965	2969	2965
q14	275	232	230	230
q15	542	482	496	482
q16	484	375	367	367
q17	963	729	689	689
q18	8224	7553	7497	7497
q19	5726	1366	1397	1366
q20	691	322	328	322
q21	4974	3218	3233	3218
q22	342	275	289	275
Total cold run time: 117851 ms
Total hot run time: 40373 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4374	4258	4223	4223
q2	371	261	268	261
q3	3010	2954	2892	2892
q4	1992	1761	1683	1683
q5	5568	5509	5450	5450
q6	231	141	134	134
q7	2276	1908	1922	1908
q8	3369	3412	3407	3407
q9	8676	8701	8663	8663
q10	4119	3876	3896	3876
q11	588	490	501	490
q12	820	617	644	617
q13	17617	3196	3187	3187
q14	313	287	297	287
q15	527	498	489	489
q16	498	435	439	435
q17	1854	1532	1498	1498
q18	8125	8043	7716	7716
q19	1702	1358	1420	1358
q20	2197	1845	1873	1845
q21	5096	4913	4766	4766
q22	569	514	508	508
Total cold run time: 73892 ms
Total hot run time: 55693 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 172802 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 28c01f30377203a58e7f78b08325b43eeba9964a, data reload: false

query1	912	388	359	359
query2	6315	1900	1835	1835
query3	6641	210	224	210
query4	25684	17460	17455	17455
query5	3723	468	497	468
query6	276	178	174	174
query7	4591	291	297	291
query8	238	205	198	198
query9	8419	2455	2460	2455
query10	442	292	276	276
query11	11832	10034	10123	10034
query12	133	88	84	84
query13	1660	375	376	375
query14	9963	7095	7696	7095
query15	244	163	163	163
query16	7240	312	304	304
query17	1824	560	529	529
query18	1877	273	271	271
query19	197	150	145	145
query20	86	82	81	81
query21	205	128	126	126
query22	4456	4151	4009	4009
query23	33913	34327	33763	33763
query24	11409	2975	2835	2835
query25	651	398	387	387
query26	1818	151	147	147
query27	2728	269	283	269
query28	7448	2115	2067	2067
query29	984	632	668	632
query30	257	148	155	148
query31	985	752	771	752
query32	91	61	58	58
query33	723	296	306	296
query34	945	505	504	504
query35	686	594	590	590
query36	1145	972	960	960
query37	171	87	85	85
query38	2992	2897	2813	2813
query39	887	879	860	860
query40	253	122	125	122
query41	47	44	46	44
query42	115	95	99	95
query43	512	474	491	474
query44	1170	724	743	724
query45	196	161	162	161
query46	1124	738	713	713
query47	1858	1773	1797	1773
query48	362	283	285	283
query49	924	411	408	408
query50	778	391	382	382
query51	6811	6796	6769	6769
query52	111	87	100	87
query53	365	285	283	283
query54	862	451	443	443
query55	75	76	73	73
query56	290	264	262	262
query57	1159	1064	1055	1055
query58	252	239	253	239
query59	2947	2601	2767	2601
query60	302	271	276	271
query61	96	110	125	110
query62	796	640	656	640
query63	320	283	289	283
query64	10407	2212	1657	1657
query65	3133	3080	3140	3080
query66	1122	331	337	331
query67	15592	15099	15050	15050
query68	4560	545	551	545
query69	445	329	325	325
query70	1180	1126	1068	1068
query71	386	276	262	262
query72	7375	5357	5201	5201
query73	741	326	325	325
query74	6171	5641	5679	5641
query75	3443	2683	2698	2683
query76	2713	897	931	897
query77	446	302	303	302
query78	11735	9249	8852	8852
query79	4316	532	525	525
query80	1828	533	478	478
query81	598	217	221	217
query82	810	140	138	138
query83	312	169	171	169
query84	276	85	90	85
query85	926	331	295	295
query86	487	308	298	298
query87	3297	3112	3115	3112
query88	4822	2376	2400	2376
query89	499	390	387	387
query90	2013	187	186	186
query91	127	111	104	104
query92	66	47	50	47
query93	4915	525	518	518
query94	1380	213	212	212
query95	406	324	308	308
query96	609	273	274	273
query97	3187	3071	3023	3023
query98	224	203	198	198
query99	1608	1236	1273	1236
Total cold run time: 288671 ms
Total hot run time: 172802 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.57 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 28c01f30377203a58e7f78b08325b43eeba9964a, data reload: false

query1	0.04	0.03	0.03
query2	0.08	0.04	0.04
query3	0.22	0.04	0.04
query4	1.67	0.07	0.07
query5	0.51	0.47	0.46
query6	1.12	0.72	0.72
query7	0.01	0.01	0.01
query8	0.05	0.04	0.04
query9	0.55	0.49	0.48
query10	0.55	0.54	0.53
query11	0.14	0.11	0.11
query12	0.15	0.12	0.11
query13	0.59	0.59	0.58
query14	0.77	0.76	0.81
query15	0.85	0.79	0.81
query16	0.36	0.36	0.38
query17	1.02	1.00	0.98
query18	0.23	0.22	0.22
query19	1.92	1.81	1.81
query20	0.01	0.01	0.02
query21	15.40	0.76	0.65
query22	4.27	5.93	2.80
query23	18.30	1.38	1.23
query24	2.09	0.24	0.22
query25	0.15	0.10	0.09
query26	0.29	0.21	0.21
query27	0.45	0.23	0.23
query28	13.21	1.02	0.99
query29	12.60	3.30	3.35
query30	0.25	0.06	0.05
query31	2.89	0.39	0.38
query32	3.29	0.48	0.48
query33	2.91	2.91	2.92
query34	17.15	4.38	4.37
query35	4.54	4.46	4.46
query36	0.66	0.47	0.50
query37	0.18	0.16	0.16
query38	0.16	0.15	0.15
query39	0.04	0.03	0.03
query40	0.15	0.12	0.11
query41	0.09	0.04	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.02 s
Total hot run time: 31.57 s

airborne12
airborne12 approved these changes Jul 16, 2024
View reviewed changes
Copy link
Member

@airborne12 airborne12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@qidaye qidaye merged commit b373135 into apache:master Jul 16, 2024
25 of 29 checks passed
seawinde pushed a commit to seawinde/doris that referenced this pull request Jul 17, 2024
@zzzxl1993 @seawinde
[opt](inverted index) mow supports index optimization (apache#37428)
a6b75b1 
1. mow support no need_read_data opt.
2. mow support topN opt.
dataroaring pushed a commit that referenced this pull request Jul 17, 2024
@zzzxl1993 @dataroaring
[opt](inverted index) mow supports index optimization (#37428)
02d96f2 
1. mow support no need_read_data opt.
2. mow support topN opt.
zzzxl1993 added a commit to zzzxl1993/doris that referenced this pull request Jul 21, 2024
@zzzxl1993
[opt](inverted index) mow supports index optimization (apache#37428)
771c0de 
1. mow support no need_read_data opt.
2. mow support topN opt.
@zzzxl1993 zzzxl1993 mentioned this pull request Jul 21, 2024
Merged
@xiaokang xiaokang added the usercase Important user case type label label Jul 31, 2024
zzzxl1993 added a commit to zzzxl1993/doris that referenced this pull request Aug 5, 2024
@zzzxl1993
[opt](inverted index) mow supports index optimization (apache#37428)
430fb9d 
1. mow support no need_read_data opt.
2. mow support topN opt.
xiaokang pushed a commit that referenced this pull request Aug 6, 2024
@zzzxl1993
[opt](inverted index) mow supports index optimization #(#38180)
ff6fa33 
## Proposed changes

#37428
#37429

<!--Describe your changes.-->
zzzxl1993 added a commit to zzzxl1993/doris that referenced this pull request Aug 6, 2024
@zzzxl1993
[opt](inverted index) mow supports index optimization #(apache#38180)
4ea0ce4 
apache#37428
apache#37429

<!--Describe your changes.-->
@gavinchou gavinchou mentioned this pull request Aug 19, 2024
Open
@yiguolei yiguolei mentioned this pull request Sep 5, 2024
Open
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@xiaokang xiaokang xiaokang left review comments

@qidaye qidaye qidaye approved these changes

@airborne12 airborne12 airborne12 approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.6-merged dev/3.0.1-merged reviewed usercase Important user case type label
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@zzzxl1993 @doris-robot @xiaokang @airborne12 @qidaye @dataroaring