You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
In join probe stage, for each input block, it will be wrapped inside ProbeProcessInfo, this is because if the build side has many duplicated key entries, the probe stage may expand the input block greatly, and inorder to keep the max-row-size of a output block, ProbeProcessInfo is used to support probe only part of the input block. That is to say for an input block, it may be probed multiple times, each time of part of the data in the block is processed.
For each probe, it will call probeBlockImplTypeCase to do the probe, and inside that function, it will calculate the hash data of the whole block:
Enhancement
In join probe stage, for each input block, it will be wrapped inside
ProbeProcessInfo
, this is because if the build side has many duplicated key entries, the probe stage may expand the input block greatly, and inorder to keep the max-row-size of a output block,ProbeProcessInfo
is used to support probe only part of the input block. That is to say for an input block, it may be probed multiple times, each time of part of the data in the block is processed.For each probe, it will call
probeBlockImplTypeCase
to do the probe, and inside that function, it will calculate the hash data of the whole block:tiflash/dbms/src/Interpreters/JoinPartition.cpp
Lines 1480 to 1494 in e597b78
If a block is probed multiple times, the hash data will be calculated multiple times, which is meaningless and redundant.
The text was updated successfully, but these errors were encountered: