Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Reduce the memory consumption by ColumnFileTiny objects #6401

Closed
Tracked by #6426
flowbehappy opened this issue Dec 1, 2022 · 3 comments
Closed
Tracked by #6426

Reduce the memory consumption by ColumnFileTiny objects #6401

flowbehappy opened this issue Dec 1, 2022 · 3 comments
Assignees
@hongyunyan
Labels
component/storage type/enhancement The issue or PR belongs to an enhancement.

Comments

@flowbehappy
Copy link
Contributor

Enhancement

bc519096-de3f-4a55-8f1a-cec5d4e18bc1

With a typical table schema, 453k ColumnFileTiny consumes over 20GiB memory.
@flowbehappy flowbehappy added type/enhancement The issue or PR belongs to an enhancement. component/storage labels Dec 1, 2022
@flowbehappy
Copy link
Contributor Author

ba80a6b4-b308-43f5-ab93-7c2ed8606264
And this part of memory is mainly consumed by PageEntry. About 12 GiB.

@flowbehappy flowbehappy mentioned this issue Dec 5, 2022
Open
6 tasks
@hongyunyan hongyunyan mentioned this issue Dec 21, 2022
Closed
12 tasks
@hongyunyan hongyunyan mentioned this issue Jan 5, 2023
Merged
12 tasks
ti-chi-bot pushed a commit that referenced this issue Feb 7, 2023
@hongyunyan
Optimization schema memory utilization of ColumnFile in instance level (
f992ced 
#6589)

ref #6401
ywqzzy pushed a commit to ywqzzy/tiflash_1 that referenced this issue Feb 13, 2023
@hongyunyan @ywqzzy
Optimization schema memory utilization of ColumnFile in instance level (
6b89097 
pingcap#6589)

ref pingcap#6401

Signed-off-by: ywqzzy <[email protected]>
@hongyunyan
Copy link
Contributor

/close

@ti-chi-bot
Copy link
Member

@hongyunyan: Closing this issue.

In response to this:

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@JaySon-Huang JaySon-Huang mentioned this issue Feb 27, 2023
Merged
12 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@hongyunyan hongyunyan

Labels
component/storage type/enhancement The issue or PR belongs to an enhancement.
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@flowbehappy @hongyunyan @ti-chi-bot