Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[fix](restore) Reset next version for restored partitions #38321

Merged
merged 1 commit into from
Jul 25, 2024
Merged

[fix](restore) Reset next version for restored partitions #38321

merged 1 commit into from
Jul 25, 2024

Conversation

w41ter
Copy link
Contributor

@w41ter w41ter commented Jul 24, 2024

No description provided.

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@w41ter
Copy link
Contributor Author

w41ter commented Jul 24, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39728 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1cbbc47eeadb5f0a4ba1a1b17992c21888fc30d0, data reload: false

------ Round 1 ----------------------------------
q1	17602	4309	4237	4237
q2	2019	187	180	180
q3	10463	1205	1078	1078
q4	10186	783	784	783
q5	7537	2755	2604	2604
q6	223	137	139	137
q7	946	591	592	591
q8	9215	2052	2071	2052
q9	8552	6580	6550	6550
q10	8849	3732	3753	3732
q11	444	239	236	236
q12	450	228	220	220
q13	17896	2950	2989	2950
q14	277	242	229	229
q15	524	475	477	475
q16	498	387	373	373
q17	960	786	723	723
q18	7999	7381	7369	7369
q19	3684	1415	1372	1372
q20	690	317	322	317
q21	4903	3234	3360	3234
q22	349	292	286	286
Total cold run time: 114266 ms
Total hot run time: 39728 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4365	4216	4218	4216
q2	385	254	266	254
q3	3012	2732	2798	2732
q4	1973	1678	1721	1678
q5	5512	5611	5496	5496
q6	223	144	134	134
q7	2171	1787	1840	1787
q8	3281	3399	3358	3358
q9	8697	8681	8791	8681
q10	4113	3915	3770	3770
q11	570	506	493	493
q12	779	609	650	609
q13	17150	3142	3172	3142
q14	328	280	296	280
q15	531	490	493	490
q16	503	449	432	432
q17	1806	1522	1493	1493
q18	8125	8067	7833	7833
q19	1824	1704	1566	1566
q20	2232	1875	1882	1875
q21	5194	4895	4919	4895
q22	582	520	479	479
Total cold run time: 73356 ms
Total hot run time: 55693 ms

@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jul 24, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-DS: Total hot run time: 172533 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1cbbc47eeadb5f0a4ba1a1b17992c21888fc30d0, data reload: false

query1	896	368	365	365
query2	6444	1905	1805	1805
query3	6646	202	214	202
query4	28173	17456	17160	17160
query5	3677	471	499	471
query6	289	182	169	169
query7	4585	294	286	286
query8	239	194	202	194
query9	8512	2416	2388	2388
query10	439	284	266	266
query11	11481	9989	9840	9840
query12	117	83	88	83
query13	1643	373	364	364
query14	10429	7214	7731	7214
query15	216	173	163	163
query16	7740	447	489	447
query17	1578	543	523	523
query18	1941	265	267	265
query19	196	149	147	147
query20	88	82	82	82
query21	219	137	127	127
query22	4339	4178	3941	3941
query23	34079	33692	33529	33529
query24	10837	2891	2922	2891
query25	604	428	393	393
query26	715	151	146	146
query27	2268	274	276	274
query28	6046	2077	2061	2061
query29	900	640	634	634
query30	256	155	160	155
query31	999	755	763	755
query32	93	53	60	53
query33	696	358	330	330
query34	896	483	493	483
query35	868	756	741	741
query36	1140	984	972	972
query37	146	76	82	76
query38	2981	2857	2823	2823
query39	921	844	852	844
query40	205	126	124	124
query41	50	45	44	44
query42	116	105	105	105
query43	514	456	465	456
query44	1126	723	725	723
query45	198	174	174	174
query46	1075	735	714	714
query47	1864	1756	1788	1756
query48	366	289	283	283
query49	819	390	401	390
query50	765	383	382	382
query51	6735	6749	6670	6670
query52	100	89	86	86
query53	358	282	290	282
query54	867	442	438	438
query55	74	74	72	72
query56	286	271	272	271
query57	1154	1081	1082	1081
query58	277	263	263	263
query59	2795	2565	2568	2565
query60	315	273	272	272
query61	93	90	94	90
query62	812	662	628	628
query63	311	280	284	280
query64	9126	2208	1648	1648
query65	3262	3128	3133	3128
query66	754	336	344	336
query67	15344	15163	14913	14913
query68	4629	542	549	542
query69	561	357	345	345
query70	1221	1120	1117	1117
query71	374	279	273	273
query72	7853	5351	5639	5351
query73	740	319	321	319
query74	6058	5626	5645	5626
query75	4120	2702	2676	2676
query76	2398	931	922	922
query77	657	310	306	306
query78	9562	10318	9039	9039
query79	2308	521	518	518
query80	981	476	468	468
query81	581	229	224	224
query82	787	136	124	124
query83	323	160	159	159
query84	254	84	83	83
query85	1658	301	294	294
query86	448	327	276	276
query87	3297	3111	3070	3070
query88	3915	2356	2364	2356
query89	471	398	374	374
query90	1823	199	194	194
query91	140	110	112	110
query92	58	52	52	52
query93	2355	586	510	510
query94	1182	294	295	294
query95	411	311	324	311
query96	604	273	270	270
query97	3237	3040	3045	3040
query98	220	195	197	195
query99	1518	1259	1294	1259
Total cold run time: 278837 ms
Total hot run time: 172533 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.19 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1cbbc47eeadb5f0a4ba1a1b17992c21888fc30d0, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.06	0.05
query4	1.67	0.09	0.09
query5	0.50	0.49	0.49
query6	1.12	0.74	0.72
query7	0.02	0.02	0.01
query8	0.06	0.04	0.04
query9	0.55	0.48	0.48
query10	0.55	0.54	0.55
query11	0.14	0.10	0.11
query12	0.15	0.13	0.12
query13	0.60	0.59	0.59
query14	0.77	0.78	0.76
query15	0.84	0.81	0.81
query16	0.35	0.37	0.37
query17	0.99	1.05	1.03
query18	0.23	0.23	0.22
query19	1.84	1.76	1.69
query20	0.01	0.01	0.01
query21	15.38	0.75	0.65
query22	4.81	7.10	1.46
query23	18.25	1.32	1.26
query24	2.14	0.23	0.22
query25	0.17	0.08	0.08
query26	0.28	0.21	0.21
query27	0.45	0.23	0.23
query28	13.27	1.01	1.01
query29	12.70	3.29	3.30
query30	0.25	0.06	0.06
query31	2.88	0.40	0.38
query32	3.28	0.48	0.47
query33	2.86	2.96	2.92
query34	17.16	4.33	4.33
query35	4.44	4.39	4.44
query36	0.65	0.47	0.47
query37	0.19	0.15	0.16
query38	0.15	0.15	0.14
query39	0.04	0.03	0.03
query40	0.15	0.12	0.13
query41	0.09	0.04	0.04
query42	0.05	0.04	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.42 s
Total hot run time: 30.19 s

dataroaring
dataroaring approved these changes Jul 25, 2024
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dataroaring dataroaring merged commit 0e76e08 into apache:master Jul 25, 2024
29 of 31 checks passed
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jul 25, 2024
@w41ter
[fix](restore) Reset next version for restored partitions
946409b 
Cherry-pick apache#38321
@w41ter w41ter mentioned this pull request Jul 25, 2024
Merged
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jul 25, 2024
@w41ter
[fix](restore) Reset next version for restored partitions
34ec767 
Cherry-pick apache#38321
@w41ter w41ter mentioned this pull request Jul 25, 2024
Merged
@w41ter w41ter deleted the reset_next_version_for_restored_partitions branch July 25, 2024 02:40
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jul 25, 2024
@w41ter
[fix](restore) Reset next version for restored partitions
1eb3998 
Cherry-pick apache#38321
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jul 25, 2024
@w41ter
[fix](restore) Reset next version for restored partitions
bf193b6 
Cherry-pick apache#38321
w41ter added a commit that referenced this pull request Jul 25, 2024
@w41ter
[fix](restore) Reset next version for restored partitions (#38343)
3d6689d 
Cherry-pick #38321
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jul 25, 2024
@w41ter
[fix](restore) Reset next version for restored partitions
5f61e00 
Cherry-pick apache#38321
w41ter added a commit to w41ter/incubator-doris that referenced this pull request Jul 25, 2024
@w41ter
[fix](restore) Reset next version for restored partitions
b088d41 
Cherry-pick apache#38321
w41ter added a commit that referenced this pull request Jul 25, 2024
@w41ter
[fix](restore) Reset next version for restored partitions (#38344)
f13363a 
Cherry-pick #38321
dataroaring pushed a commit that referenced this pull request Aug 11, 2024
@w41ter @dataroaring
[fix](restore) Reset next version for restored partitions (#38321)
5b5d189
dataroaring pushed a commit that referenced this pull request Aug 16, 2024
@w41ter @dataroaring
[fix](restore) Reset next version for restored partitions (#38321)
9530db5
mongo360 pushed a commit to mongo360/doris that referenced this pull request Aug 16, 2024
@w41ter
[fix](restore) Reset next version for restored partitions (apache#38344)
240a986 
Cherry-pick apache#38321
@w41ter w41ter mentioned this pull request Aug 26, 2024
Closed
@gavinchou gavinchou mentioned this pull request Oct 13, 2024
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@dataroaring dataroaring dataroaring approved these changes

@gavinchou gavinchou gavinchou approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.0.14-merged dev/2.1.6-merged dev/3.0.2-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
4 participants
@w41ter @doris-robot @gavinchou @dataroaring