Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add doc for binary format support in k-NN #7840

Merged
merged 12 commits into from
Aug 1, 2024

Conversation

junqiu-lei
Copy link
Member

@junqiu-lei junqiu-lei commented Jul 25, 2024

Description

Add doc for binary format support in k-NN

Issues Resolved

Closes #7835

Version

Since 2.16

Frontend features

N/A

Checklist

  • By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license and subject to the Developers Certificate of Origin.
    For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Copy link

Thank you for submitting your PR. The PR states are In progress (or Draft) -> Tech review -> Doc review -> Editorial review -> Merged.

Before you submit your PR for doc review, make sure the content is technically accurate. If you need help finding a tech reviewer, tag a maintainer.

When you're ready for doc review, tag the assignee of this PR. The doc reviewer may push edits to the PR directly or leave comments and editorial suggestions for you to address (let us know in a comment if you have a preference). The doc reviewer will arrange for an editorial review.

@junqiu-lei junqiu-lei assigned junqiu-lei and unassigned hdhalter Jul 25, 2024
@kolchfa-aws kolchfa-aws self-assigned this Jul 26, 2024
@hdhalter hdhalter added the release-notes PR: Include this PR in the automated release notes label Jul 29, 2024
@heemin32
Copy link
Contributor

Could you add hamming as space type in
https://opensearch.org/docs/latest/search-plugins/knn/knn-score-script/?

The difference between hammingbit and hamming is that, hamming works only with knn field of binary data type whereas hammingbit works with long and binary type(https://opensearch.org/docs/latest/search-plugins/sql/datatypes/).

Signed-off-by: Junqiu Lei <[email protected]>
@junqiu-lei
Copy link
Member Author

Could you add hamming as space type in https://opensearch.org/docs/latest/search-plugins/knn/knn-score-script/?

The difference between hammingbit and hamming is that, hamming works only with knn field of binary data type whereas hammingbit works with long and binary type(https://opensearch.org/docs/latest/search-plugins/sql/datatypes/).

Added

@hdhalter hdhalter added 3 - Tech review PR: Tech review in progress 4 - Doc review PR: Doc review in progress and removed 3 - Tech review PR: Tech review in progress labels Jul 29, 2024
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@junqiu-lei @kolchfa-aws Please see my comments and changes and let me know if you have any questions. Thanks!

_field-types/supported-field-types/knn-vector.md Outdated Show resolved Hide resolved
_field-types/supported-field-types/knn-vector.md Outdated Show resolved Hide resolved
_field-types/supported-field-types/knn-vector.md Outdated Show resolved Hide resolved
_field-types/supported-field-types/knn-vector.md Outdated Show resolved Hide resolved
_field-types/supported-field-types/knn-vector.md Outdated Show resolved Hide resolved
_field-types/supported-field-types/knn-vector.md Outdated Show resolved Hide resolved
_field-types/supported-field-types/knn-vector.md Outdated Show resolved Hide resolved
_field-types/supported-field-types/knn-vector.md Outdated Show resolved Hide resolved
_search-plugins/knn/knn-index.md Outdated Show resolved Hide resolved
_search-plugins/knn/knn-score-script.md Outdated Show resolved Hide resolved
kolchfa-aws and others added 2 commits August 1, 2024 10:32
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
@junqiu-lei
Copy link
Member Author

@junqiu-lei @kolchfa-aws Please see my comments and changes and let me know if you have any questions. Thanks!

The changes LGTM, thanks!

Copy link
Collaborator

@natebower natebower left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@kolchfa-aws Just a couple of minor additions. Thanks!

@@ -363,11 +363,11 @@ GET /test-binary-hnsw/_search
```
{% include copy-curl.html %}

Query results will be returned:
The response contains two vectors closest to the query vector:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

"the" two vectors

@@ -628,15 +621,16 @@ GET test-binary-ivf/_search
```
{% include copy-curl.html %}

Query results will be returned:
The response contains two vectors closest to the query vector:
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same

Signed-off-by: Fanit Kolchina <[email protected]>
Copy link
Collaborator

@kolchfa-aws kolchfa-aws left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thank you, @junqiu-lei!

@kolchfa-aws kolchfa-aws merged commit 73ab08c into opensearch-project:main Aug 1, 2024
6 checks passed
@hdhalter hdhalter added 3 - Done Issue is done/complete and removed 4 - Doc review PR: Doc review in progress labels Aug 1, 2024
mingshl pushed a commit to mingshl/documentation-website that referenced this pull request Aug 2, 2024
* Add doc for binary format support in k-NN

Signed-off-by: Junqiu Lei <[email protected]>

* Resolve tech feedback

Signed-off-by: Junqiu Lei <[email protected]>

* Doc review

Signed-off-by: Fanit Kolchina <[email protected]>

* Add newline

Signed-off-by: Fanit Kolchina <[email protected]>

* Formatting

Signed-off-by: Fanit Kolchina <[email protected]>

* Link fix

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Add query results to examples

Signed-off-by: Junqiu Lei <[email protected]>

* Rephrased sentences and changed vector field name

Signed-off-by: Fanit Kolchina <[email protected]>

* Editorial review

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove details from one of the requests

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Junqiu Lei <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Naarcha-AWS added a commit that referenced this pull request Aug 7, 2024
* add ingest-attachment plugin doc

Signed-off-by: Ricky Lippmann <[email protected]>

* extend ingest-attachment with information how to limit content

Signed-off-by: Ricky Lippmann <[email protected]>

* Added target_bulk_bytes to the docs for logstash-output plugin (#7869)

* Added target_bulk_bytes

Signed-off-by: Sander van de Geijn <[email protected]>

* Update _tools/logstash/ship-to-opensearch.md

Nice

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Sander van de Geijn <[email protected]>

* Update _tools/logstash/ship-to-opensearch.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update ship-to-opensearch.md

* Remove "we"

* Update ship-to-opensearch.md

* Update ship-to-opensearch.md

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Sander van de Geijn <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Add doc for binary format support in k-NN (#7840)

* Add doc for binary format support in k-NN

Signed-off-by: Junqiu Lei <[email protected]>

* Resolve tech feedback

Signed-off-by: Junqiu Lei <[email protected]>

* Doc review

Signed-off-by: Fanit Kolchina <[email protected]>

* Add newline

Signed-off-by: Fanit Kolchina <[email protected]>

* Formatting

Signed-off-by: Fanit Kolchina <[email protected]>

* Link fix

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Add query results to examples

Signed-off-by: Junqiu Lei <[email protected]>

* Rephrased sentences and changed vector field name

Signed-off-by: Fanit Kolchina <[email protected]>

* Editorial review

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove details from one of the requests

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Junqiu Lei <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Edit for redundant information and sections across Data Prepper (#7127)

* Edit for redundant information and sections across Data Prepper

Signed-off-by: Melissa Vagi <[email protected]>

* Edit for redundant information and sections across Data Prepper

Signed-off-by: Melissa Vagi <[email protected]>

* Rewrite expression syntax and reorganize doc structure for readability

Signed-off-by: Melissa Vagi <[email protected]>

* Rewrite expression syntax and reorganize doc structure for readability

Signed-off-by: Melissa Vagi <[email protected]>

* Rewrite expression syntax and reorganize doc structure for readability

Signed-off-by: Melissa Vagi <[email protected]>

* Rewrite expression syntax and reorganize doc structure for readability

Signed-off-by: Melissa Vagi <[email protected]>

* Rewrite expression syntax and reorganize doc structure for readability

Signed-off-by: Melissa Vagi <[email protected]>

* Update _data-prepper/index.md

Signed-off-by: Melissa Vagi <[email protected]>

* Update configuring-data-prepper.md

Signed-off-by: Melissa Vagi <[email protected]>

Signed-off-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/expression-syntax.md

Signed-off-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/expression-syntax.md

Signed-off-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/pipelines.md

Signed-off-by: Melissa Vagi <[email protected]>

* Update expression-syntax.md

Signed-off-by: Melissa Vagi <[email protected]>

* Create Functions subpages

Signed-off-by: Melissa Vagi <[email protected]>

* Create functions subpages

Signed-off-by: Melissa Vagi <[email protected]>

* Copy edit

Signed-off-by: Melissa Vagi <[email protected]>

* add remaining subpages

Signed-off-by: Melissa Vagi <[email protected]>

* Update _data-prepper/index.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Heather Halter <[email protected]>

* Apply suggestions from code review

Accepted editorial suggestions.

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Heather Halter <[email protected]>

* Apply suggestions from code review

Accepted more editorial suggestions that were hidden.

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Heather Halter <[email protected]>

* Apply suggestions from code review

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: David Venable <[email protected]>

* removed-line

Signed-off-by: Heather Halter <[email protected]>

* Fixed broken link to pipelines

Signed-off-by: Heather Halter <[email protected]>

* Fixed broken links on Update add-entries.md

Signed-off-by: Heather Halter <[email protected]>

* Fixed broken link in Update dynamo-db.md

Signed-off-by: Heather Halter <[email protected]>

* Fixed link syntax in Update index.md

Signed-off-by: Heather Halter <[email protected]>

---------

Signed-off-by: Melissa Vagi <[email protected]>
Signed-off-by: Heather Halter <[email protected]>
Signed-off-by: David Venable <[email protected]>
Signed-off-by: Heather Halter <[email protected]>
Co-authored-by: Heather Halter <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Co-authored-by: David Venable <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Update index.md (#7893)

fixed typo

Signed-off-by: Philipp Dünnebeil <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Fix typo and make left nav heading uniform for neural sparse processor (#7895)

Signed-off-by: kolchfa-aws <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Add custom JSON lexer and highlighting color scheme (#7892)

* Add custom JSON lexer and highlighting color scheme

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _getting-started/quickstart.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Add model names to Vale (#7901)

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Renamed data prepper files to have dashes for consistency (#7790)

* Renamed data prepper files to have dashes for consistency

Signed-off-by: Fanit Kolchina <[email protected]>

* More files

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Add documentation for ml inference search request processor/ search response processor (#7852)

* draft ml inference search request processor

Signed-off-by: Mingshi Liu <[email protected]>

* add doc

Signed-off-by: Mingshi Liu <[email protected]>

* add doc

Signed-off-by: Mingshi Liu <[email protected]>

* Doc review

Signed-off-by: Fanit Kolchina <[email protected]>

* Fixed links

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Unify processor docs

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _query-dsl/geo-and-xy/xy.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Remove note

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix link

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Mingshi Liu <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Refactor k-NN documentation (#7890)

* Refactor k-NN documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Change field name for cohesiveness

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Heather Halter <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Ml commons batch inference (#7899)

* add batch inference API

Signed-off-by: Xun Zhang <[email protected]>

* add more links and mark the api as experimental

Signed-off-by: Xun Zhang <[email protected]>

* use openAI as the blueprint example details

Signed-off-by: Xun Zhang <[email protected]>

* address comments

Signed-off-by: Xun Zhang <[email protected]>

* Doc review

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Xun Zhang <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Remove repeated sentence in distributed tracing doc (#7906)

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Add apostrophe token filter page #7871 (#7884)

* adding apostrophe token filter page #7871

Signed-off-by: AntonEliatra <[email protected]>

* fixing vale error

Signed-off-by: AntonEliatra <[email protected]>

* Update apostrophe-token-filter.md

Signed-off-by: AntonEliatra <[email protected]>

* updating the naming

Signed-off-by: AntonEliatra <[email protected]>

* updating as per the review comments

Signed-off-by: AntonEliatra <[email protected]>

* updating the heading to Apostrophe token filter

Signed-off-by: AntonEliatra <[email protected]>

* updating as per PR comments

Signed-off-by: AntonEliatra <[email protected]>

* Apply suggestions from code review

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: AntonEliatra <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: AntonEliatra <[email protected]>

---------

Signed-off-by: AntonEliatra <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* removed unnecessary backslash

Signed-off-by: Ricky Lippmann <[email protected]>

* fix:add missing whitespace in table

Signed-off-by: Ricky Lippmann <[email protected]>

* docs: add link to tika supported file formats

Signed-off-by: Ricky Lippmann <[email protected]>

* Update ingest-attachment-plugin.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* adjust to keep technical specific information with improved wording

Signed-off-by: Ricky Lippmann <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Ricky Lippmann <[email protected]>
Signed-off-by: Sander van de Geijn <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Junqiu Lei <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Signed-off-by: Melissa Vagi <[email protected]>
Signed-off-by: Heather Halter <[email protected]>
Signed-off-by: David Venable <[email protected]>
Signed-off-by: Heather Halter <[email protected]>
Signed-off-by: Philipp Dünnebeil <[email protected]>
Signed-off-by: Mingshi Liu <[email protected]>
Signed-off-by: Xun Zhang <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: AntonEliatra <[email protected]>
Co-authored-by: Sander van de Geijn <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Co-authored-by: Junqiu Lei <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Heather Halter <[email protected]>
Co-authored-by: David Venable <[email protected]>
Co-authored-by: Philipp Dünnebeil <[email protected]>
Co-authored-by: Mingshi Liu <[email protected]>
Co-authored-by: Xun Zhang <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: AntonEliatra <[email protected]>
opensearch-trigger-bot bot pushed a commit that referenced this pull request Aug 7, 2024
* add ingest-attachment plugin doc

Signed-off-by: Ricky Lippmann <[email protected]>

* extend ingest-attachment with information how to limit content

Signed-off-by: Ricky Lippmann <[email protected]>

* Added target_bulk_bytes to the docs for logstash-output plugin (#7869)

* Added target_bulk_bytes

Signed-off-by: Sander van de Geijn <[email protected]>

* Update _tools/logstash/ship-to-opensearch.md

Nice

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Sander van de Geijn <[email protected]>

* Update _tools/logstash/ship-to-opensearch.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update ship-to-opensearch.md

* Remove "we"

* Update ship-to-opensearch.md

* Update ship-to-opensearch.md

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Sander van de Geijn <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Add doc for binary format support in k-NN (#7840)

* Add doc for binary format support in k-NN

Signed-off-by: Junqiu Lei <[email protected]>

* Resolve tech feedback

Signed-off-by: Junqiu Lei <[email protected]>

* Doc review

Signed-off-by: Fanit Kolchina <[email protected]>

* Add newline

Signed-off-by: Fanit Kolchina <[email protected]>

* Formatting

Signed-off-by: Fanit Kolchina <[email protected]>

* Link fix

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Add query results to examples

Signed-off-by: Junqiu Lei <[email protected]>

* Rephrased sentences and changed vector field name

Signed-off-by: Fanit Kolchina <[email protected]>

* Editorial review

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove details from one of the requests

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Junqiu Lei <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Edit for redundant information and sections across Data Prepper (#7127)

* Edit for redundant information and sections across Data Prepper

Signed-off-by: Melissa Vagi <[email protected]>

* Edit for redundant information and sections across Data Prepper

Signed-off-by: Melissa Vagi <[email protected]>

* Rewrite expression syntax and reorganize doc structure for readability

Signed-off-by: Melissa Vagi <[email protected]>

* Rewrite expression syntax and reorganize doc structure for readability

Signed-off-by: Melissa Vagi <[email protected]>

* Rewrite expression syntax and reorganize doc structure for readability

Signed-off-by: Melissa Vagi <[email protected]>

* Rewrite expression syntax and reorganize doc structure for readability

Signed-off-by: Melissa Vagi <[email protected]>

* Rewrite expression syntax and reorganize doc structure for readability

Signed-off-by: Melissa Vagi <[email protected]>

* Update _data-prepper/index.md

Signed-off-by: Melissa Vagi <[email protected]>

* Update configuring-data-prepper.md

Signed-off-by: Melissa Vagi <[email protected]>

Signed-off-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/expression-syntax.md

Signed-off-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/expression-syntax.md

Signed-off-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/pipelines.md

Signed-off-by: Melissa Vagi <[email protected]>

* Update expression-syntax.md

Signed-off-by: Melissa Vagi <[email protected]>

* Create Functions subpages

Signed-off-by: Melissa Vagi <[email protected]>

* Create functions subpages

Signed-off-by: Melissa Vagi <[email protected]>

* Copy edit

Signed-off-by: Melissa Vagi <[email protected]>

* add remaining subpages

Signed-off-by: Melissa Vagi <[email protected]>

* Update _data-prepper/index.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Heather Halter <[email protected]>

* Apply suggestions from code review

Accepted editorial suggestions.

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Heather Halter <[email protected]>

* Apply suggestions from code review

Accepted more editorial suggestions that were hidden.

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Heather Halter <[email protected]>

* Apply suggestions from code review

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: David Venable <[email protected]>

* removed-line

Signed-off-by: Heather Halter <[email protected]>

* Fixed broken link to pipelines

Signed-off-by: Heather Halter <[email protected]>

* Fixed broken links on Update add-entries.md

Signed-off-by: Heather Halter <[email protected]>

* Fixed broken link in Update dynamo-db.md

Signed-off-by: Heather Halter <[email protected]>

* Fixed link syntax in Update index.md

Signed-off-by: Heather Halter <[email protected]>

---------

Signed-off-by: Melissa Vagi <[email protected]>
Signed-off-by: Heather Halter <[email protected]>
Signed-off-by: David Venable <[email protected]>
Signed-off-by: Heather Halter <[email protected]>
Co-authored-by: Heather Halter <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Co-authored-by: David Venable <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Update index.md (#7893)

fixed typo

Signed-off-by: Philipp Dünnebeil <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Fix typo and make left nav heading uniform for neural sparse processor (#7895)

Signed-off-by: kolchfa-aws <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Add custom JSON lexer and highlighting color scheme (#7892)

* Add custom JSON lexer and highlighting color scheme

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _getting-started/quickstart.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Add model names to Vale (#7901)

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Renamed data prepper files to have dashes for consistency (#7790)

* Renamed data prepper files to have dashes for consistency

Signed-off-by: Fanit Kolchina <[email protected]>

* More files

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Add documentation for ml inference search request processor/ search response processor (#7852)

* draft ml inference search request processor

Signed-off-by: Mingshi Liu <[email protected]>

* add doc

Signed-off-by: Mingshi Liu <[email protected]>

* add doc

Signed-off-by: Mingshi Liu <[email protected]>

* Doc review

Signed-off-by: Fanit Kolchina <[email protected]>

* Fixed links

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Unify processor docs

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _query-dsl/geo-and-xy/xy.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Remove note

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix link

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Mingshi Liu <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Refactor k-NN documentation (#7890)

* Refactor k-NN documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Change field name for cohesiveness

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Heather Halter <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Ml commons batch inference (#7899)

* add batch inference API

Signed-off-by: Xun Zhang <[email protected]>

* add more links and mark the api as experimental

Signed-off-by: Xun Zhang <[email protected]>

* use openAI as the blueprint example details

Signed-off-by: Xun Zhang <[email protected]>

* address comments

Signed-off-by: Xun Zhang <[email protected]>

* Doc review

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Xun Zhang <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Remove repeated sentence in distributed tracing doc (#7906)

Signed-off-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* Add apostrophe token filter page #7871 (#7884)

* adding apostrophe token filter page #7871

Signed-off-by: AntonEliatra <[email protected]>

* fixing vale error

Signed-off-by: AntonEliatra <[email protected]>

* Update apostrophe-token-filter.md

Signed-off-by: AntonEliatra <[email protected]>

* updating the naming

Signed-off-by: AntonEliatra <[email protected]>

* updating as per the review comments

Signed-off-by: AntonEliatra <[email protected]>

* updating the heading to Apostrophe token filter

Signed-off-by: AntonEliatra <[email protected]>

* updating as per PR comments

Signed-off-by: AntonEliatra <[email protected]>

* Apply suggestions from code review

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: AntonEliatra <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: AntonEliatra <[email protected]>

---------

Signed-off-by: AntonEliatra <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Ricky Lippmann <[email protected]>

* removed unnecessary backslash

Signed-off-by: Ricky Lippmann <[email protected]>

* fix:add missing whitespace in table

Signed-off-by: Ricky Lippmann <[email protected]>

* docs: add link to tika supported file formats

Signed-off-by: Ricky Lippmann <[email protected]>

* Update ingest-attachment-plugin.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* adjust to keep technical specific information with improved wording

Signed-off-by: Ricky Lippmann <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Ricky Lippmann <[email protected]>
Signed-off-by: Sander van de Geijn <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Junqiu Lei <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Signed-off-by: Melissa Vagi <[email protected]>
Signed-off-by: Heather Halter <[email protected]>
Signed-off-by: David Venable <[email protected]>
Signed-off-by: Heather Halter <[email protected]>
Signed-off-by: Philipp Dünnebeil <[email protected]>
Signed-off-by: Mingshi Liu <[email protected]>
Signed-off-by: Xun Zhang <[email protected]>
Signed-off-by: Peter Alfonsi <[email protected]>
Signed-off-by: AntonEliatra <[email protected]>
Co-authored-by: Sander van de Geijn <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Co-authored-by: Junqiu Lei <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Heather Halter <[email protected]>
Co-authored-by: David Venable <[email protected]>
Co-authored-by: Philipp Dünnebeil <[email protected]>
Co-authored-by: Mingshi Liu <[email protected]>
Co-authored-by: Xun Zhang <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: Peter Alfonsi <[email protected]>
Co-authored-by: AntonEliatra <[email protected]>
(cherry picked from commit 8b731c5)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Done Issue is done/complete release-notes PR: Include this PR in the automated release notes v2.16.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[DOC] Support binary format vector in k-NN
5 participants