Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Index FMSketch takes up too much TiDB memory #42052

Closed
xuyifangreeneyes opened this issue Mar 9, 2023 · 1 comment · Fixed by #42074
Closed

Index FMSketch takes up too much TiDB memory #42052

xuyifangreeneyes opened this issue Mar 9, 2023 · 1 comment · Fixed by #42074
Labels
affects-5.1 This bug affects 5.1.x versions. affects-5.2 This bug affects 5.2.x versions. affects-5.3 This bug affects 5.3.x versions. affects-5.4 This bug affects the 5.4.x(LTS) versions. affects-6.0 affects-6.1 This bug affects the 6.1.x(LTS) versions. affects-6.2 affects-6.3 affects-6.4 affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-6.6 component/statistics severity/major sig/planner SIG: Planner type/bug The issue is confirmed as a bug.

Comments

@xuyifangreeneyes
Copy link
Contributor

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

Create many tables(> 1000) and collect their statistics. Observe the memory profiling result.

2. What did you expect to see? (Required)

Index FMSketch would not be directly used by optimizer. Hence, we should not load it into memory.

3. What did you see instead (Required)

Index FMSketch takes up too much TiDB memory.

20230309-144711

4. What is your TiDB version? (Required)

v6.5.0(master also has the problem)
@xuyifangreeneyes xuyifangreeneyes added type/bug The issue is confirmed as a bug. sig/planner SIG: Planner component/statistics labels Mar 9, 2023
@xuyifangreeneyes xuyifangreeneyes mentioned this issue Mar 9, 2023
Merged
12 tasks
@ti-chi-bot ti-chi-bot added may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-6.1 may-affects-6.5 labels Mar 9, 2023
@xuyifangreeneyes xuyifangreeneyes added affects-5.1 This bug affects 5.1.x versions. affects-5.2 This bug affects 5.2.x versions. affects-5.3 This bug affects 5.3.x versions. affects-5.4 This bug affects the 5.4.x(LTS) versions. affects-6.0 affects-6.1 This bug affects the 6.1.x(LTS) versions. affects-6.2 affects-6.3 affects-6.4 and removed may-affects-4.0 This bug maybe affects 4.0.x versions. may-affects-5.1 This bug maybe affects 5.1.x versions. may-affects-5.2 This bug maybe affects 5.2.x versions. may-affects-5.3 This bug maybe affects 5.3.x versions. may-affects-5.4 This bug maybe affects 5.4.x versions. may-affects-5.0 This bug maybe affects 5.0.x versions. may-affects-6.1 may-affects-6.5 labels Mar 9, 2023
@xuyifangreeneyes xuyifangreeneyes added affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-6.6 labels Mar 9, 2023
ti-chi-bot pushed a commit that referenced this issue Mar 10, 2023
@xuyifangreeneyes
statistics: fix unnecessary index fmsketch loading (#42074)
cdab358 
close #42052
@xuyifangreeneyes
Copy link
Contributor Author

/cherry-pick release-6.5

@ti-chi-bot ti-chi-bot mentioned this issue May 30, 2023
Closed
12 tasks
@xuyifangreeneyes xuyifangreeneyes mentioned this issue Jun 1, 2023
Merged
12 tasks
ti-chi-bot bot pushed a commit that referenced this issue Jun 1, 2023
@xuyifangreeneyes
statistics: fix unnecessary index fmsketch loading (#44330)
cf696ae 
close #42052
This was referenced Jun 30, 2023
Merged
Open
Closed
ti-chi-bot bot pushed a commit that referenced this issue Jul 1, 2023
@ti-chi-bot
statistics: fix unnecessary index fmsketch loading (#42074) (#45083)
c71f045 
close #42052
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
affects-5.1 This bug affects 5.1.x versions. affects-5.2 This bug affects 5.2.x versions. affects-5.3 This bug affects 5.3.x versions. affects-5.4 This bug affects the 5.4.x(LTS) versions. affects-6.0 affects-6.1 This bug affects the 6.1.x(LTS) versions. affects-6.2 affects-6.3 affects-6.4 affects-6.5 This bug affects the 6.5.x(LTS) versions. affects-6.6 component/statistics severity/major sig/planner SIG: Planner type/bug The issue is confirmed as a bug.
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

statistics: fix unnecessary index fmsketch loading xuyifangreeneyes/tidb
2 participants
@xuyifangreeneyes @ti-chi-bot