Limitations in columnar sort

[kepler42]

The limitation mentioned in docs mention not supporting spill. But there are multiple test cases for sort supporting spill to the disk using external sorter and the sort and spill method within sort kernel.

The limitations talked about are they due to these variables?
uint32_t id = 0;
uint32_t array_id = 0;

[zhouyuan]

Hi @kepler42

Yes, the limitation is due to some small data structure used(unit16_t, to reduce the memory footprint) in 1.4 and previous releases. We are working on to fix these in 1.5, here's the 1st patch:
#1038
The code path on Spilling support will also need to be cleaned up, WIP

-yuan