Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Opt](TabletSchema) reuse TabletColumn info to reduce mem (#42448) #43326

Merged
merged 1 commit into from
Nov 6, 2024

Commits on Nov 6, 2024

  1. [Opt](TabletSchema) reuse TabletColumn info to reduce mem (apache#42448)

    1. When there are a large number of identical TabletColumns in the
    cluster, which usually occurs when VARIANT type columns are modified and
    added, each Rowset has an individual TabletSchema. Excessive
    TabletSchemas can lead to significant memory overhead. Reusing memory
    for identical TabletColumns would greatly reduce this memory
    consumption.
    2. Serialized TabletSchema as LRU cache key could also increase memusage
    when large sets of schemas are in LRU cache, so inorder to reduce the
    memory footprint we just record the key signature caculated by
    generating an UUID by hash algorithm, and lookup the key signature in
    LRU cache, and check the key in case of hash collision
    eldenmoon committed Nov 6, 2024
    Configuration menu
    Copy the full SHA
    fc8cbc5 View commit details
    Browse the repository at this point in the history