You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@jhorstmann 👋 I recently noticed this discrepency whislt doing some testing for a project that uses Arrow dictionaries. Did you want to take this ticket otherwise I'm happy to fix it.
Describe the bug
The memory usage calculation for dictionary arrays seems to report twice the actual used memory.
In the above code,
self.keys
andself.values
are pointing to the same data that is inself.data
and so would be counted twice.Additional context
The memory usage calculation could actually work the same for all array types and could be implemented as a default method on the
Array
trait.The text was updated successfully, but these errors were encountered: