Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[branch-3.0](broker-load) fix error in broker-load with read_json_by_line (#41788) #43471

Open
wants to merge 1 commit into
base: branch-3.0
Choose a base branch
from

Conversation

wyxxxcat
Copy link
Contributor

@wyxxxcat wyxxxcat commented Nov 7, 2024

pick #41788

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@wyxxxcat
Copy link
Contributor Author

wyxxxcat commented Nov 7, 2024

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 39966 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 097965a6f80f1e12e3e219f3bcc936167e371fa3, data reload: false

------ Round 1 ----------------------------------
q1	17577	7407	7230	7230
q2	2076	173	157	157
q3	10688	1049	1119	1049
q4	10541	676	720	676
q5	7753	2803	2807	2803
q6	226	145	145	145
q7	955	609	594	594
q8	9587	1909	1973	1909
q9	7466	6370	6358	6358
q10	6959	2295	2326	2295
q11	460	275	259	259
q12	397	212	209	209
q13	17802	2970	2992	2970
q14	246	215	215	215
q15	612	529	501	501
q16	675	605	584	584
q17	954	590	527	527
q18	7184	6492	6413	6413
q19	1852	1016	998	998
q20	457	191	188	188
q21	4056	3150	2944	2944
q22	1083	1015	942	942
Total cold run time: 109606 ms
Total hot run time: 39966 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7322	7191	7238	7191
q2	392	286	307	286
q3	2844	2864	2860	2860
q4	1992	1752	1744	1744
q5	5631	5683	5728	5683
q6	221	146	140	140
q7	2179	1797	1790	1790
q8	3346	3561	3481	3481
q9	8756	8753	8781	8753
q10	3520	3494	3485	3485
q11	619	503	510	503
q12	806	590	613	590
q13	16618	3154	3164	3154
q14	303	270	266	266
q15	597	554	549	549
q16	712	681	664	664
q17	1863	1610	1601	1601
q18	8139	7750	7417	7417
q19	6823	1487	1556	1487
q20	2076	1876	1852	1852
q21	5453	5283	5444	5283
q22	1109	1025	997	997
Total cold run time: 81321 ms
Total hot run time: 59776 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192955 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 097965a6f80f1e12e3e219f3bcc936167e371fa3, data reload: false

query1	2438	2045	2283	2045
query2	6237	2152	2119	2119
query3	13870	10767	237	237
query4	34647	23684	23625	23625
query5	5404	440	451	440
query6	353	177	183	177
query7	5175	303	307	303
query8	314	232	230	230
query9	9666	2710	2696	2696
query10	505	256	258	256
query11	18420	15207	15114	15114
query12	161	98	101	98
query13	1555	446	423	423
query14	11213	6850	7114	6850
query15	226	183	178	178
query16	7688	508	507	507
query17	1423	576	574	574
query18	2343	626	633	626
query19	242	184	178	178
query20	122	110	116	110
query21	206	106	105	105
query22	4695	4328	4304	4304
query23	34910	33920	33725	33725
query24	6825	3373	3347	3347
query25	545	411	403	403
query26	736	186	187	186
query27	1694	295	295	295
query28	4510	2516	2494	2494
query29	723	447	431	431
query30	360	306	304	304
query31	992	800	829	800
query32	74	56	53	53
query33	510	279	283	279
query34	902	504	505	504
query35	843	725	723	723
query36	1043	949	944	944
query37	112	71	72	71
query38	3892	3842	3908	3842
query39	1478	1415	1414	1414
query40	204	104	100	100
query41	51	53	50	50
query42	103	99	92	92
query43	540	492	506	492
query44	1132	792	778	778
query45	182	170	169	169
query46	1113	713	708	708
query47	1883	1806	1809	1806
query48	460	370	375	370
query49	744	396	394	394
query50	818	411	409	409
query51	7192	7128	7025	7025
query52	99	85	89	85
query53	254	182	184	182
query54	541	443	434	434
query55	77	75	74	74
query56	244	226	237	226
query57	1201	1081	1098	1081
query58	210	197	202	197
query59	3172	2995	3064	2995
query60	289	253	239	239
query61	104	104	115	104
query62	752	659	664	659
query63	212	179	184	179
query64	3009	662	630	630
query65	3262	3181	3170	3170
query66	698	302	305	302
query67	15995	15368	15166	15166
query68	4666	571	577	571
query69	409	257	254	254
query70	1171	1122	1154	1122
query71	321	256	253	253
query72	6401	3866	3890	3866
query73	747	351	338	338
query74	10318	8919	8801	8801
query75	3274	2577	2604	2577
query76	2023	983	951	951
query77	371	260	259	259
query78	10823	9531	9762	9531
query79	8819	588	596	588
query80	2291	420	416	416
query81	571	238	239	238
query82	1621	119	118	118
query83	286	157	161	157
query84	291	77	75	75
query85	1283	303	287	287
query86	472	278	300	278
query87	4527	4349	4156	4156
query88	5518	2442	2423	2423
query89	526	293	289	289
query90	2267	180	182	180
query91	179	146	145	145
query92	68	49	47	47
query93	7690	550	539	539
query94	1044	296	267	267
query95	338	243	243	243
query96	614	282	283	282
query97	3297	3117	3156	3117
query98	224	192	199	192
query99	1600	1287	1269	1269
Total cold run time: 315643 ms
Total hot run time: 192955 ms

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants