Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Document crate topology (#2594) #2913

Merged
merged 2 commits into from
Oct 24, 2022

Conversation

tustvold
Copy link
Contributor

Which issue does this PR close?

Part of #2594

Rationale for this change

I found it non-trivial to find the documentation I wrote for managing arrow arrays, this is because the module docs were moved to the crate docs for arrow_array.

What changes are included in this PR?

Adds documentation on the crate topology, and updates links to reference these sub-crates

Are there any user-facing changes?

No, this just updates docs

@github-actions github-actions bot added the arrow Changes to the arrow crate label Oct 22, 2022
@@ -15,7 +15,7 @@
// specific language governing permissions and limitations
// under the License.

//! Buffer abstractions for [Apache Arrow](https://docs.rs/arrow)
//! Array data abstractions for [Apache Arrow](https://docs.rs/arrow)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Drive by fix for a copypasta

arrow/src/lib.rs Outdated
Comment on lines 34 to 38
//! * [`arrow_buffer`] - buffer abstractions for arrow arrays
//! * [`arrow_schema`] - the logical types for arrow arrays
//! * [`arrow_data`] - the underlying data of arrow arrays
//! * [`arrow_array`] - type-safe arrow array abstractions
//! * [`arrow_select`] - selection kernels for arrow arrays
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I had to alphabetize them to compare with https://github.com/apache/arrow-rs -- so figured it might help others

Suggested change
//! * [`arrow_buffer`] - buffer abstractions for arrow arrays
//! * [`arrow_schema`] - the logical types for arrow arrays
//! * [`arrow_data`] - the underlying data of arrow arrays
//! * [`arrow_array`] - type-safe arrow array abstractions
//! * [`arrow_select`] - selection kernels for arrow arrays
//! * [`arrow_array`] - type-safe arrow array abstractions
//! * [`arrow_buffer`] - buffer abstractions for arrow arrays
//! * [`arrow_data`] - the underlying data of arrow arrays
//! * [`arrow_schema`] - the logical types for arrow arrays
//! * [`arrow_select`] - selection kernels for arrow arrays

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Would it also help to mention that some crates, such as arrow-flight are meant to be used by themselves (not as an implementation detail of arrow)?

arrow/src/lib.rs Outdated
//! # Columnar Format
//!
//! The [`array`] module provides statically typed implementations of all the array
//! types as defined by the [Arrow Columnar Format](https://arrow.apache.org/docs/format/Columnar.html).
//! [`arrow_array`] provides statically typed implementations of all the array types as defined
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Given I think the above says the subcrates are re-exported as the public API I suggest keeping this example in terms of arrow (though updating the links to the arrow-array subcrate would be fine)

@alamb alamb added the documentation Improvements or additions to documentation label Oct 24, 2022
@tustvold tustvold merged commit bca8445 into apache:master Oct 24, 2022
@ursabot
Copy link

ursabot commented Oct 25, 2022

Benchmark runs are scheduled for baseline = 28d6152 and contender = bca8445. bca8445 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Skipped ⚠️ Benchmarking of arrow-rs-commits is not supported on ec2-t3-xlarge-us-east-2] ec2-t3-xlarge-us-east-2
[Skipped ⚠️ Benchmarking of arrow-rs-commits is not supported on test-mac-arm] test-mac-arm
[Skipped ⚠️ Benchmarking of arrow-rs-commits is not supported on ursa-i9-9960x] ursa-i9-9960x
[Skipped ⚠️ Benchmarking of arrow-rs-commits is not supported on ursa-thinkcentre-m75q] ursa-thinkcentre-m75q
Buildkite builds:
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
arrow Changes to the arrow crate documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants