-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[opt](memory) max_sys_mem_available_low_water_mark_bytes
default value modified to 6.4G
#37174
[opt](memory) max_sys_mem_available_low_water_mark_bytes
default value modified to 6.4G
#37174
Conversation
Thank you for your contribution to Apache Doris. Since 2024-03-18, the Document has been moved to doris-website. |
run buildall |
clang-tidy review says "All clean, LGTM! 👍" |
TPC-H: Total hot run time: 39914 ms
|
TPC-DS: Total hot run time: 172194 ms
|
ClickBench: Total hot run time: 30.73 s
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
PR approved by at least one committer and no changes requested. |
PR approved by anyone and no changes requested. |
run buildall |
clang-tidy review says "All clean, LGTM! 👍" |
TPC-H: Total hot run time: 40265 ms
|
TPC-DS: Total hot run time: 172897 ms
|
ClickBench: Total hot run time: 30.24 s
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
## Proposed changes #37174 increased max sys_mem_available_low_water_mark from 1.6G to 6.4G, causing memtable memory limiter reserving too much memory. This PR adds a BE config `memtable_limiter_reserved_memory_bytes`, defaults to 800MB, which defines bytes reserved in memtable memory limiter.
…ue modified to 6.4G (apache#37174) // The maximum low water mark of the system `/proc/meminfo/MemAvailable`, Unit byte, default 6.4G, // actual low water mark=min(6.4G, MemTotal * 10%), avoid wasting too much memory on machines // with large memory larger than 64G. // Turn up max. On machines with more than 64G memory, more memory buffers will be reserved for Full GC. // Turn down max. will use as much memory as possible.
…ue modified to 6.4G (apache#37174) // The maximum low water mark of the system `/proc/meminfo/MemAvailable`, Unit byte, default 6.4G, // actual low water mark=min(6.4G, MemTotal * 10%), avoid wasting too much memory on machines // with large memory larger than 64G. // Turn up max. On machines with more than 64G memory, more memory buffers will be reserved for Full GC. // Turn down max. will use as much memory as possible.
) ## Proposed changes apache#37174 increased max sys_mem_available_low_water_mark from 1.6G to 6.4G, causing memtable memory limiter reserving too much memory. This PR adds a BE config `memtable_limiter_reserved_memory_bytes`, defaults to 800MB, which defines bytes reserved in memtable memory limiter.
…ue modified to 6.4G (#37174) // The maximum low water mark of the system `/proc/meminfo/MemAvailable`, Unit byte, default 6.4G, // actual low water mark=min(6.4G, MemTotal * 10%), avoid wasting too much memory on machines // with large memory larger than 64G. // Turn up max. On machines with more than 64G memory, more memory buffers will be reserved for Full GC. // Turn down max. will use as much memory as possible.
## Proposed changes #37174 increased max sys_mem_available_low_water_mark from 1.6G to 6.4G, causing memtable memory limiter reserving too much memory. This PR adds a BE config `memtable_limiter_reserved_memory_bytes`, defaults to 800MB, which defines bytes reserved in memtable memory limiter.
// The maximum low water mark of the system
/proc/meminfo/MemAvailable
, Unit byte, default 6.4G,// actual low water mark=min(6.4G, MemTotal * 10%), avoid wasting too much memory on machines
// with large memory larger than 64G.
// Turn up max. On machines with more than 64G memory, more memory buffers will be reserved for Full GC.
// Turn down max. will use as much memory as possible.