Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the pipeline subdocument to the Sources document #8211

Merged
merged 2 commits into from
Sep 13, 2024

Conversation

linghengqian
Copy link
Contributor

@linghengqian linghengqian commented Sep 11, 2024

Description

Describe what this change achieves.

  • Add the pipeline subdocument to the Sources document.

Issues Resolved

List any issues this PR will resolve, e.g. Closes [...].

Version

List the OpenSearch version to which this PR applies, e.g. 2.14, 2.12--2.14, or all.

  • all

Frontend features

If you're submitting documentation for an OpenSearch Dashboards feature, add a video that shows how a user will interact with the UI step by step. A voiceover is optional.

  • No need.

Checklist

  • By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
    For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Copy link

Thank you for submitting your PR. The PR states are In progress (or Draft) -> Tech review -> Doc review -> Editorial review -> Merged.

Before you submit your PR for doc review, make sure the content is technically accurate. If you need help finding a tech reviewer, tag a maintainer.

When you're ready for doc review, tag the assignee of this PR. The doc reviewer may push edits to the PR directly or leave comments and editorial suggestions for you to address (let us know in a comment if you have a preference). The doc reviewer will arrange for an editorial review.

Copy link
Member

@dlvenable dlvenable left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you @linghengqian for this contribution!

@kolchfa-aws , Does this look good from you perspective? If so, I'd like to get this in. This functionality is applicable for all versions of Data Prepper.

@kolchfa-aws kolchfa-aws assigned kolchfa-aws and unassigned vagimeli Sep 11, 2024
Copy link
Collaborator

@kolchfa-aws kolchfa-aws left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you, @linghengqian! Just a couple of fixes. I've added a suggestion to fix the topic order as part of this PR but please feel free to put in an issue instead. Thanks!

title: pipeline
parent: Sources
grand_parent: Pipelines
nav_order: 55
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The topic names under "Sources" are not alphabetized. Could you fix that as part of this PR? Use Pascal numbering (multiples of 10).

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • I don't seem to see any directories following the so-called Pascal numbering (multiples of 10). I made a new commit, should it look like this?

@@ -0,0 +1,30 @@
---
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The configuration directory seems unnecessary. Just want to flag this for a future fix. This just makes the link longer (and shorter links are preferable for SEO). We can fix that by removing the configuration folder and adding redirects from the old link to the new link in all files under the pipelines directory. @vagimeli Could you please put in an issue to fix this?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Issue #8223

_data-prepper/pipelines/configuration/sources/pipeline.md Outdated Show resolved Hide resolved
_data-prepper/pipelines/configuration/sources/pipeline.md Outdated Show resolved Hide resolved
_data-prepper/pipelines/configuration/sources/pipeline.md Outdated Show resolved Hide resolved
source:
- pipeline:
name: "movies"
```
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
```
```
{% include copy.html %}

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking at the Data Prepper section, none of the yaml snippets have the yaml highlighter or copy button added. @vagimeli Could you please put in an issue to fix this?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Issue #8223

_data-prepper/pipelines/configuration/sources/pipeline.md Outdated Show resolved Hide resolved
Copy link
Collaborator

@kolchfa-aws kolchfa-aws left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you, @linghengqian! Moving the PR into editorial review. Once it's done, we'll be ready to merge.

Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@kolchfa-aws kolchfa-aws merged commit 8ba63fe into opensearch-project:main Sep 13, 2024
5 checks passed
opensearch-trigger-bot bot pushed a commit that referenced this pull request Sep 13, 2024
Signed-off-by: linghengqian <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
(cherry picked from commit 8ba63fe)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
@linghengqian linghengqian deleted the new-doc branch September 13, 2024 13:18
noahstaveley pushed a commit to noahstaveley/documentation-website that referenced this pull request Sep 23, 2024
…project#8211)

Signed-off-by: linghengqian <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Noah Staveley <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Sources documentation should add pipeline subdocumentation
5 participants