Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-31809: [Docs] Add instructions on how to collect the produced telemetry data #33873

Merged
merged 6 commits into from
Feb 7, 2023

Conversation

amoeba
Copy link
Member

@amoeba amoeba commented Jan 26, 2023

Rationale for this change

The codebase has been partially implemented with the OpenTelemetry SDK and it would be beneficial for users to have a concise guide on how to get started collecting and visualizing tracing data.

What changes are included in this PR?

This is an initial draft for review of an addition to the C++ User Guide as mentioned in #31809 (comment).

Are these changes tested?

These changes have been tested locally by building the docs and verifying.

Are there any user-facing changes?

Yes, but just documentation changes.

@github-actions
Copy link

@github-actions
Copy link

⚠️ GitHub issue #31809 has been automatically assigned in GitHub to PR creator.

@amoeba
Copy link
Member Author

amoeba commented Jan 26, 2023

I've published a built version of the new page in the docs this PR creates to https://63d1d0cd7dae342ddeb4db1a--arrow-docs.netlify.app/cpp/opentelemetry.html for easier viewing.

For whoever reviews, I think a very high-level review would be a good first step. Is this the right shape? Is this in the right location in the docs? I tried to match the style of other user guides in terms of structure and style and avoided writing this up in the more pedagogical style of https://github.com/amoeba/arrow-opentelemetry-example.

@joosthooz
Copy link
Contributor

Hi, I think this is a really great step because it allows users to at least get started with tracing! At some point we may want to explain some more about how to read the traces. But the telemetry code in Arrow is currently still in flux so there might be some changes coming up wrt the structure and naming of spans. Thanks for this. Maybe @mbrobbel would like to have a look?

Copy link
Contributor

@mbrobbel mbrobbel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is great! I added two minor suggestions.

I agree with @joosthooz that we should defer documenting the trace structure until that stabilizes.

docs/source/cpp/opentelemetry.rst Outdated Show resolved Hide resolved
docs/source/cpp/opentelemetry.rst Outdated Show resolved Hide resolved
@amoeba
Copy link
Member Author

amoeba commented Jan 26, 2023

Thanks for taking a look at this @joosthooz and @mbrobbel.

@mbrobbel I accepted both of your suggestions, re-wrapped your one change as you mentioned. I also replicated the changes to the the list of options for ARROW_TRACING_BACKEND in env_vars.rst so both pages are identical.

An updated preview build of the docs is available at https://63d2f00e3c06c61b7852ce4a--tranquil-faloodeh-d58aad.netlify.app/cpp/opentelemetry.html. This is ready for another look and/or a merge.

@amoeba
Copy link
Member Author

amoeba commented Feb 7, 2023

Hi @mbrobbel, do you want to look at this again or is this ready for a merge?

@mbrobbel
Copy link
Contributor

mbrobbel commented Feb 7, 2023

I approved it, but I'm not a committer so I can't merge it. Maybe @westonpace or @lidavidm can help merge this?

@lidavidm lidavidm changed the title GH-31809: [Tools][Docs] Add instructions on how to collect the produced telemetry data GH-31809: [Docs] Add instructions on how to collect the produced telemetry data Feb 7, 2023
@lidavidm lidavidm merged commit 63cb14e into apache:master Feb 7, 2023
@amoeba
Copy link
Member Author

amoeba commented Feb 7, 2023

Thank you @lidavidm!

@ursabot
Copy link

ursabot commented Feb 8, 2023

Benchmark runs are scheduled for baseline = a6ace68 and contender = 63cb14e. 63cb14e is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Failed ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Failed ⬇️0.52% ⬆️0.03%] test-mac-arm
[Failed ⬇️0.0% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️1.11% ⬆️0.03%] ursa-thinkcentre-m75q
Buildkite builds:
[Failed] 63cb14e3 ec2-t3-xlarge-us-east-2
[Failed] 63cb14e3 test-mac-arm
[Failed] 63cb14e3 ursa-i9-9960x
[Finished] 63cb14e3 ursa-thinkcentre-m75q
[Failed] a6ace685 ec2-t3-xlarge-us-east-2
[Failed] a6ace685 test-mac-arm
[Failed] a6ace685 ursa-i9-9960x
[Finished] a6ace685 ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

sjperkins pushed a commit to sjperkins/arrow that referenced this pull request Feb 10, 2023
…d telemetry data (apache#33873)

### Rationale for this change

The codebase has been partially implemented with the OpenTelemetry SDK and it would be beneficial for users to have a concise guide on how to get started collecting and visualizing tracing data.

### What changes are included in this PR?

This is an initial draft for review of an addition to the [C++ User Guide](https://arrow.apache.org/docs/dev/cpp/user_guide.html) as mentioned in apache#31809 (comment).

### Are these changes tested?

These changes have been tested locally by building the docs and verifying.

### Are there any user-facing changes?

Yes, but just documentation changes.
* Closes: apache#31809

Lead-authored-by: Bryce Mecum <[email protected]>
Co-authored-by: Matthijs Brobbel <[email protected]>
Signed-off-by: David Li <[email protected]>
gringasalpastor pushed a commit to gringasalpastor/arrow that referenced this pull request Feb 17, 2023
…d telemetry data (apache#33873)

### Rationale for this change

The codebase has been partially implemented with the OpenTelemetry SDK and it would be beneficial for users to have a concise guide on how to get started collecting and visualizing tracing data.

### What changes are included in this PR?

This is an initial draft for review of an addition to the [C++ User Guide](https://arrow.apache.org/docs/dev/cpp/user_guide.html) as mentioned in apache#31809 (comment).

### Are these changes tested?

These changes have been tested locally by building the docs and verifying.

### Are there any user-facing changes?

Yes, but just documentation changes.
* Closes: apache#31809

Lead-authored-by: Bryce Mecum <[email protected]>
Co-authored-by: Matthijs Brobbel <[email protected]>
Signed-off-by: David Li <[email protected]>
fatemehp pushed a commit to fatemehp/arrow that referenced this pull request Feb 24, 2023
…d telemetry data (apache#33873)

### Rationale for this change

The codebase has been partially implemented with the OpenTelemetry SDK and it would be beneficial for users to have a concise guide on how to get started collecting and visualizing tracing data.

### What changes are included in this PR?

This is an initial draft for review of an addition to the [C++ User Guide](https://arrow.apache.org/docs/dev/cpp/user_guide.html) as mentioned in apache#31809 (comment).

### Are these changes tested?

These changes have been tested locally by building the docs and verifying.

### Are there any user-facing changes?

Yes, but just documentation changes.
* Closes: apache#31809

Lead-authored-by: Bryce Mecum <[email protected]>
Co-authored-by: Matthijs Brobbel <[email protected]>
Signed-off-by: David Li <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Tools][Docs] Add instructions on how to collect the produced telemetry data
5 participants