Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update parquet crate documentation and examples #1253

Merged
merged 1 commit into from
Feb 2, 2022

Conversation

alamb
Copy link
Contributor

@alamb alamb commented Feb 1, 2022

Builds on #1154 so draft until that is merged

Which issue does this PR close?

Re #111

Rationale for changes

The docs.rs page is pretty sparse https://docs.rs/parquet/8.0.0/parquet/
Screen Shot 2022-02-01 at 8 51 37 AM

And there are no doc examples for using the new async reader api defined in #111

What changes are included in this PR?

  1. Moved async parquet test to doc example
  2. Cleaned up the landing page to make the examples more discoverable
  3. Cleaned up sync arrow writer doc example:
    Screen Shot 2022-02-01 at 8 52 03 AM

Screen Shot 2022-02-01 at 8 52 19 AM

Are there any user-facing changes?

Docs

@alamb alamb added the documentation Improvements or additions to documentation label Feb 1, 2022
@github-actions github-actions bot added arrow Changes to the arrow crate parquet Changes to the parquet crate labels Feb 1, 2022
@alamb alamb marked this pull request as draft February 1, 2022 13:53
Copy link
Contributor

@tustvold tustvold left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

😍 Thank you for this

//!
//! use parquet::arrow::ParquetRecordBatchStreamBuilder;
//!
//! # fn assert_batches_eq(batches: &[RecordBatch], expected_lines: &[&str]) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TIL that you can hide doc code using # 👍

@alamb alamb marked this pull request as ready for review February 2, 2022 11:33
@alamb alamb merged commit 3ddb156 into apache:master Feb 2, 2022
@alamb alamb deleted the alamb/examples branch February 13, 2022 13:14
@alamb
Copy link
Contributor Author

alamb commented Feb 13, 2022

Sadly, the link to the async reader doc doesn't seem to work on docs.rs: #1307

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
arrow Changes to the arrow crate documentation Improvements or additions to documentation parquet Changes to the parquet crate
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants