refactor(rust): Remove top-level metadata from ArrowSchema

[nameexhaustion]

Preparation for unifying schemas to struct Schema<D>

[codecov]

Codecov Report

Attention: Patch coverage is 88.88889% with 1 line in your changes missing coverage. Please review.

Project coverage is 79.84%. Comparing base (f5edd91) to head (3840ba3).
Report is 44 commits behind head on main.

Files with missing lines	Patch %	Lines
crates/polars-arrow/src/io/ipc/read/file_async.rs	0.00%	1 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main   #18527      +/-   ##
==========================================
- Coverage   79.85%   79.84%   -0.02%     
==========================================
  Files        1501     1501              
  Lines      201865   201823      -42     
  Branches     2868     2868              
==========================================
- Hits       161202   161144      -58     
- Misses      40117    40133      +16     
  Partials      546      546              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[lukapeschke]

Hi, I have a question about this change: we're currently using polars v0.41.3, and use polars_arrow::ipc::write::stream_async::StreamSink to serialize our dataframes to arrow IPC data. We were using ArrowSchema::with_metadata to add custom applicative metadata at the schema level.

Is it still possible to add schema-level metadata with polars v0.43 ? If yes, could you please point me to the right resources ? Thanks!

[nameexhaustion]

Is it still possible to add schema-level metadata with polars v0.43 ? If yes, could you please point me to the right resources ? Thanks!

We don't intend on adding schema-level metadata to the ArrowSchema, however we plan to add functions to the reader / writers to load / save custom metadata.

[lukapeschke]

@nameexhaustion great thanks! Do you have a specific polars release for which this is planned ? If not, could I help on that in any way ?

[nameexhaustion]

@nameexhaustion great thanks! Do you have a specific polars release for which this is planned ? If not, could I help on that in any way ?

There's an open issue for this at #17560