Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

blocking sync load take too much time. #57710

Closed
hawkingrei opened this issue Nov 26, 2024 · 0 comments · Fixed by #57712
Closed

blocking sync load take too much time. #57710

hawkingrei opened this issue Nov 26, 2024 · 0 comments · Fixed by #57712
Labels
affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. severity/major sig/planner SIG: Planner type/bug The issue is confirmed as a bug.

Comments

@hawkingrei
Copy link
Member

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

In order to reproduce the problem easily locally, it is recommended to reduce the configuration file parameter stats-load-queue-size and the system variable tidb_stats_load_sync_wait. It is easier to reproduce the problem if you adjust them to 10 and 1 respectively.
You only need to trigger a large number of fast stats sync load tasks to trigger this problem. I have 2,000 tables locally, each with 20 columns and 20 indexes. Using a script to quickly access all columns of all tables can trigger the problem. The SQL example is as follows.

SELECT * FROM %s WHERE c1 = 1 AND c2 = 2 AND c3 = 3 AND c4 = 4 AND c5 = 5 AND c6 = 6 AND c7 = 7 AND c8 = 8 AND c9 = 9 AND c10 = 10 AND c11 = 1 AND c12 = 2 AND c13 = 3 AND c14 = 4 AND c15 = 5 AND c16 = 6 AND c17 = 7 AND c18 = 8 AND c19 = 9 AND c20 = 10

2. What did you expect to see? (Required)

no any time

3. What did you see instead (Required)

Image

4. What is your TiDB version? (Required)

v8.1.0

@hawkingrei hawkingrei added the type/bug The issue is confirmed as a bug. label Nov 26, 2024
@hawkingrei hawkingrei added affects-8.5 This bug affects the 8.5.x(LTS) versions. affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. type/bug The issue is confirmed as a bug. sig/planner SIG: Planner severity/major and removed type/bug The issue is confirmed as a bug. sig/planner SIG: Planner severity/major may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.1 may-affects-6.5 may-affects-7.1 may-affects-7.5 may-affects-8.1 labels Nov 26, 2024
@ti-chi-bot ti-chi-bot bot closed this as completed in d0de86b Nov 27, 2024
@ti-chi-bot ti-chi-bot bot added affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-6.5 This bug affects the 6.5.x(LTS) versions. labels Nov 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-7.1 This bug affects the 7.1.x(LTS) versions. affects-7.5 This bug affects the 7.5.x(LTS) versions. affects-8.1 This bug affects the 8.1.x(LTS) versions. affects-8.5 This bug affects the 8.5.x(LTS) versions. severity/major sig/planner SIG: Planner type/bug The issue is confirmed as a bug.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant