You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have one of the blocks which is ~7GB of size. And Compact can't do anything with it. It is OOM killed every time. Is there any way to instruct Compact to process big blocks piecemeal
Here is part of meta.json file:
"version": 1,
"ulid": "01CRYM9RYN78DFKZ73XB4H4WCP",
"minTime": 1537401600000,
"maxTime": 1538611200000,
"stats": {
"numSamples": 4489155614,
"numSeries": 2088751,
"numChunks": 39194144
},
here is graphs for compact pod:
here is an error:
level=info ts=2019-01-10T20:46:34.747142839Z caller=compact.go:822 msg="start of GC"
level=info ts=2019-01-10T20:46:34.78464068Z caller=compact.go:207 msg="compaction iterations done"
level=info ts=2019-01-10T20:46:34.784681757Z caller=compact.go:214 msg="start first pass of downsampling"
level=info ts=2019-01-10T20:48:27.547013191Z caller=downsample.go:212 msg="downloaded block" id=01CRYM9RYN78DFKZ73XB4H4WCP duration=1m52.526675454s
fatal error: runtime: out of memory
The text was updated successfully, but these errors were encountered:
Compactor now supports sharding so you could use that as a temporary workaround to reduce RAM usage but we could definitely provide some guidance on how much RAM is needed since it seems like this is a recurring topic: #1928
I have one of the blocks which is ~7GB of size. And Compact can't do anything with it. It is OOM killed every time. Is there any way to instruct Compact to process big blocks piecemeal
Here is part of meta.json file:
"version": 1,
"ulid": "01CRYM9RYN78DFKZ73XB4H4WCP",
"minTime": 1537401600000,
"maxTime": 1538611200000,
"stats": {
"numSamples": 4489155614,
"numSeries": 2088751,
"numChunks": 39194144
},
here is graphs for compact pod:
here is an error:
level=info ts=2019-01-10T20:46:34.747142839Z caller=compact.go:822 msg="start of GC"
level=info ts=2019-01-10T20:46:34.78464068Z caller=compact.go:207 msg="compaction iterations done"
level=info ts=2019-01-10T20:46:34.784681757Z caller=compact.go:214 msg="start first pass of downsampling"
level=info ts=2019-01-10T20:48:27.547013191Z caller=downsample.go:212 msg="downloaded block" id=01CRYM9RYN78DFKZ73XB4H4WCP duration=1m52.526675454s
fatal error: runtime: out of memory
The text was updated successfully, but these errors were encountered: