Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[pipeline](API) Add a new API to find pipeline tasks by a specific query ID #35563

Merged
merged 1 commit into from
May 29, 2024
Merged

[pipeline](API) Add a new API to find pipeline tasks by a specific query ID #35563

merged 1 commit into from
May 29, 2024

Conversation

Gabriel39
Copy link
Contributor

…ery ID

Proposed changes

Issue Number: close #xxx

image

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@Gabriel39
Copy link
Contributor Author

run buildall

@yiguolei yiguolei changed the title [pipeline](API) Add a new API to find pipeline tasks by a specific qu… [pipeline](API) Add a new API to find pipeline tasks by a specific query ID May 29, 2024
@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label May 29, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@github-actions GitHub Actions
Copy link
Contributor

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 41285 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 8aca9c34242d4bd92643f1f7082e0f0c5d8f16f2, data reload: false

------ Round 1 ----------------------------------
q1	17618	4462	4309	4309
q2	2037	194	203	194
q3	10433	1229	1208	1208
q4	10200	935	810	810
q5	7498	2729	2731	2729
q6	226	132	135	132
q7	972	642	616	616
q8	9218	2165	2112	2112
q9	9852	6715	6761	6715
q10	9763	3939	3926	3926
q11	438	245	246	245
q12	446	217	233	217
q13	17209	3158	3224	3158
q14	288	231	231	231
q15	513	471	474	471
q16	490	383	384	383
q17	964	687	747	687
q18	8388	7867	7814	7814
q19	1877	1593	1475	1475
q20	653	316	304	304
q21	5252	3986	3276	3276
q22	357	273	284	273
Total cold run time: 114692 ms
Total hot run time: 41285 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4540	4368	4463	4368
q2	377	284	285	284
q3	3144	2944	2941	2941
q4	1980	1612	1609	1609
q5	5332	5513	5477	5477
q6	209	124	125	124
q7	2238	1834	1785	1785
q8	3266	3424	3400	3400
q9	8684	8678	8710	8678
q10	4105	3756	3672	3672
q11	590	511	509	509
q12	805	623	608	608
q13	16892	3141	3179	3141
q14	318	262	274	262
q15	537	510	485	485
q16	506	451	462	451
q17	1826	1522	1532	1522
q18	7756	7681	7341	7341
q19	7883	1586	1612	1586
q20	2022	1767	1770	1767
q21	5028	4820	4683	4683
q22	585	503	502	502
Total cold run time: 78623 ms
Total hot run time: 55195 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 35.76% (9009/25191)
Line Coverage: 27.37% (74555/272378)
Region Coverage: 26.59% (38578/145063)
Branch Coverage: 23.46% (19666/83812)
Coverage Report: http://coverage.selectdb-in.cc/coverage/8aca9c34242d4bd92643f1f7082e0f0c5d8f16f2_8aca9c34242d4bd92643f1f7082e0f0c5d8f16f2/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 172850 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 8aca9c34242d4bd92643f1f7082e0f0c5d8f16f2, data reload: false

query1	929	376	377	376
query2	6453	2489	2413	2413
query3	6655	204	201	201
query4	19158	17461	17322	17322
query5	4140	425	438	425
query6	245	162	151	151
query7	4588	312	296	296
query8	241	184	185	184
query9	8439	2372	2360	2360
query10	453	292	278	278
query11	10625	10160	10057	10057
query12	138	90	87	87
query13	1641	376	371	371
query14	9397	7046	7770	7046
query15	218	178	167	167
query16	7797	264	273	264
query17	1739	527	518	518
query18	1967	281	269	269
query19	208	156	149	149
query20	95	87	86	86
query21	197	131	133	131
query22	4080	3982	3773	3773
query23	33926	33191	33041	33041
query24	10204	2791	2883	2791
query25	572	358	364	358
query26	708	157	154	154
query27	2231	332	329	329
query28	5282	2049	2021	2021
query29	877	618	607	607
query30	246	147	150	147
query31	959	767	744	744
query32	91	56	54	54
query33	656	277	264	264
query34	882	490	486	486
query35	719	623	603	603
query36	1061	919	920	919
query37	101	65	68	65
query38	2911	2751	2799	2751
query39	852	812	792	792
query40	198	125	122	122
query41	47	44	45	44
query42	103	101	98	98
query43	560	552	590	552
query44	1091	729	759	729
query45	179	163	166	163
query46	1072	731	713	713
query47	1860	1765	1788	1765
query48	385	298	299	298
query49	866	397	401	397
query50	784	398	408	398
query51	6861	6866	6776	6776
query52	101	92	99	92
query53	357	296	290	290
query54	876	451	441	441
query55	77	76	74	74
query56	281	265	275	265
query57	1132	1050	1074	1050
query58	280	222	218	218
query59	3416	3449	3337	3337
query60	272	288	259	259
query61	91	87	92	87
query62	603	464	456	456
query63	319	293	290	290
query64	8511	2230	1717	1717
query65	3142	3098	3123	3098
query66	791	335	325	325
query67	15142	15105	14933	14933
query68	4552	552	581	552
query69	446	271	272	271
query70	1160	1125	1124	1124
query71	372	274	269	269
query72	7659	5531	5517	5517
query73	723	322	330	322
query74	6085	5680	5615	5615
query75	3357	2628	2624	2624
query76	2419	979	974	974
query77	594	268	273	268
query78	10197	10120	9816	9816
query79	2034	518	516	516
query80	1116	431	427	427
query81	540	224	222	222
query82	700	90	91	90
query83	251	169	164	164
query84	248	88	83	83
query85	1833	270	270	270
query86	494	274	295	274
query87	3261	3117	3164	3117
query88	4189	2361	2338	2338
query89	473	396	371	371
query90	2036	190	186	186
query91	124	101	97	97
query92	59	51	49	49
query93	2451	501	490	490
query94	1287	184	180	180
query95	405	314	301	301
query96	583	270	261	261
query97	3139	3020	2959	2959
query98	239	227	223	223
query99	1192	845	843	843
Total cold run time: 265296 ms
Total hot run time: 172850 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.67 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 8aca9c34242d4bd92643f1f7082e0f0c5d8f16f2, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.06	0.05
query4	1.65	0.09	0.07
query5	0.51	0.50	0.52
query6	1.12	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.04
query9	0.54	0.49	0.49
query10	0.54	0.56	0.55
query11	0.16	0.11	0.12
query12	0.15	0.12	0.12
query13	0.59	0.59	0.59
query14	0.78	0.80	0.78
query15	0.83	0.80	0.81
query16	0.36	0.38	0.36
query17	1.04	1.02	1.05
query18	0.23	0.27	0.25
query19	1.75	1.70	1.72
query20	0.02	0.01	0.01
query21	15.58	0.67	0.66
query22	4.53	7.06	1.94
query23	18.28	1.34	1.27
query24	1.63	0.29	0.20
query25	0.15	0.08	0.07
query26	0.27	0.16	0.16
query27	0.08	0.08	0.07
query28	13.42	1.01	1.00
query29	13.29	3.38	3.34
query30	0.26	0.05	0.05
query31	2.86	0.38	0.40
query32	3.26	0.46	0.46
query33	2.83	2.87	2.89
query34	17.30	4.43	4.42
query35	4.46	4.48	4.80
query36	0.64	0.50	0.46
query37	0.17	0.15	0.16
query38	0.14	0.14	0.14
query39	0.05	0.04	0.04
query40	0.16	0.14	0.15
query41	0.09	0.05	0.05
query42	0.05	0.04	0.05
query43	0.04	0.03	0.04
Total cold run time: 110.23 s
Total hot run time: 30.67 s

@Gabriel39 Gabriel39 merged commit fae2b4b into apache:master May 29, 2024
27 of 30 checks passed
dataroaring pushed a commit that referenced this pull request May 31, 2024
@Gabriel39 @dataroaring
[pipeline](API) Add a new API to find pipeline tasks by a specific qu…
359f456 
…ery ID (#35563)
Gabriel39 added a commit to Gabriel39/incubator-doris that referenced this pull request Oct 22, 2024
@Gabriel39
[pipeline](API) Add a new API to find pipeline tasks by a specific qu…
da68649 
…ery ID (apache#35563)
@Gabriel39 Gabriel39 mentioned this pull request Oct 22, 2024
Merged
Gabriel39 added a commit that referenced this pull request Oct 22, 2024
@Gabriel39
[pipeline](API) Add a new API to find pipeline tasks by a specific qu… (
8877267 
#42233)

…ery ID (#35563)

pick #35563
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yiguolei yiguolei yiguolei approved these changes

@BiteTheDDDDt BiteTheDDDDt BiteTheDDDDt approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/2.1.7-merged dev/3.0.0-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@Gabriel39 @doris-robot @BiteTheDDDDt @yiguolei @dataroaring