Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove support for sparse vectors. #48781

Merged
merged 6 commits into from
Nov 14, 2019
Merged

Remove support for sparse vectors. #48781

Show file tree
Hide file tree
Changes from 4 commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
92f3189
Remove support for sparse vectors.
jtibshirani Oct 30, 2019
bc29036
Remove the superclass VectorScriptDocValues.
jtibshirani Oct 31, 2019
4e2e24e
Remove VectorEncoderDecoderTests.
jtibshirani Oct 31, 2019
0242a5e
Update the migration documentation.
jtibshirani Oct 31, 2019
129b120
Add a note that SparseVectorFieldMapper should be removed in 9.0.
jtibshirani Nov 14, 2019
b5fefee
Merge remote-tracking branch 'upstream/master' into remove-sparse-vector
jtibshirani Nov 14, 2019
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 1 addition & 5 deletions docs/painless/painless-api-reference/painless-api-reference-score/index.asciidoc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,7 +11,6 @@ The following specialized API is available in the Score context.
The following methods are directly callable without a class/instance qualifier. Note parameters denoted by a (*) are treated as read-only values.

* double cosineSimilarity(List *, String)
* double cosineSimilaritySparse(Map *, String)
* double decayDateExp(String *, String *, String *, double *, JodaCompatibleZonedDateTime)
* double decayDateGauss(String *, String *, String *, double *, JodaCompatibleZonedDateTime)
* double decayDateLinear(String *, String *, String *, double *, JodaCompatibleZonedDateTime)
Expand All @@ -22,7 +21,6 @@ The following methods are directly callable without a class/instance qualifier.
* double decayNumericGauss(double *, double *, double *, double *, double)
* double decayNumericLinear(double *, double *, double *, double *, double)
* double dotProduct(List, String)
* double dotProductSparse(Map *, String)
* double randomScore(int *)
* double randomScore(int *, String *)
* double saturation(double, double)
Expand All @@ -35,9 +33,7 @@ The following classes are available grouped by their respective packages. Click
==== org.elasticsearch.index.query
<<painless-api-reference-score-org-elasticsearch-index-query, Expand details for org.elasticsearch.index.query>>

* <<painless-api-reference-score-VectorScriptDocValues, VectorScriptDocValues>>
* <<painless-api-reference-score-VectorScriptDocValues-DenseVectorScriptDocValues, VectorScriptDocValues.DenseVectorScriptDocValues>>
* <<painless-api-reference-score-VectorScriptDocValues-SparseVectorScriptDocValues, VectorScriptDocValues.SparseVectorScriptDocValues>>
* <<painless-api-reference-score-DenseVectorScriptDocValues, DenseVectorScriptDocValues>>

include::packages.asciidoc[]

118 changes: 2 additions & 116 deletions .../painless/painless-api-reference/painless-api-reference-score/packages.asciidoc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,8 @@
=== Score API for package org.elasticsearch.index.query
See the <<painless-api-reference-score, Score API>> for a high-level overview of all packages and classes.

[[painless-api-reference-score-VectorScriptDocValues]]
==== VectorScriptDocValues
[[painless-api-reference-score-DenseVectorScriptDocValues]]
==== DenseVectorScriptDocValues
* boolean {java11-javadoc}/java.base/java/util/Collection.html#add(java.lang.Object)[add](def)
* void {java11-javadoc}/java.base/java/util/List.html#add(int,java.lang.Object)[add](int, def)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#addAll(java.util.Collection)[addAll](Collection)
Expand Down Expand Up @@ -59,117 +59,3 @@ See the <<painless-api-reference-score, Score API>> for a high-level overview of
* def[] {java11-javadoc}/java.base/java/util/Collection.html#toArray()[toArray]()
* def[] {java11-javadoc}/java.base/java/util/Collection.html#toArray(java.lang.Object%5B%5D)[toArray](def[])
* String {java11-javadoc}/java.base/java/lang/Object.html#toString()[toString]()


[[painless-api-reference-score-VectorScriptDocValues-DenseVectorScriptDocValues]]
==== VectorScriptDocValues.DenseVectorScriptDocValues
* boolean {java11-javadoc}/java.base/java/util/Collection.html#add(java.lang.Object)[add](def)
* void {java11-javadoc}/java.base/java/util/List.html#add(int,java.lang.Object)[add](int, def)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#addAll(java.util.Collection)[addAll](Collection)
* boolean {java11-javadoc}/java.base/java/util/List.html#addAll(int,java.util.Collection)[addAll](int, Collection)
* boolean any(Predicate)
* Collection asCollection()
* List asList()
* void {java11-javadoc}/java.base/java/util/Collection.html#clear()[clear]()
* List collect(Function)
* def collect(Collection, Function)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#contains(java.lang.Object)[contains](def)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#containsAll(java.util.Collection)[containsAll](Collection)
* def each(Consumer)
* def eachWithIndex(ObjIntConsumer)
* boolean {java11-javadoc}/java.base/java/util/List.html#equals(java.lang.Object)[equals](Object)
* boolean every(Predicate)
* def find(Predicate)
* List findAll(Predicate)
* def findResult(Function)
* def findResult(def, Function)
* List findResults(Function)
* void {java11-javadoc}/java.base/java/lang/Iterable.html#forEach(java.util.function.Consumer)[forEach](Consumer)
* def {java11-javadoc}/java.base/java/util/List.html#get(int)[get](int)
* Object getByPath(String)
* Object getByPath(String, Object)
* int getLength()
* Map groupBy(Function)
* int {java11-javadoc}/java.base/java/util/List.html#hashCode()[hashCode]()
* int {java11-javadoc}/java.base/java/util/List.html#indexOf(java.lang.Object)[indexOf](def)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#isEmpty()[isEmpty]()
* Iterator {java11-javadoc}/java.base/java/lang/Iterable.html#iterator()[iterator]()
* String join(String)
* int {java11-javadoc}/java.base/java/util/List.html#lastIndexOf(java.lang.Object)[lastIndexOf](def)
* ListIterator {java11-javadoc}/java.base/java/util/List.html#listIterator()[listIterator]()
* ListIterator {java11-javadoc}/java.base/java/util/List.html#listIterator(int)[listIterator](int)
* def {java11-javadoc}/java.base/java/util/List.html#remove(int)[remove](int)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#removeAll(java.util.Collection)[removeAll](Collection)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#removeIf(java.util.function.Predicate)[removeIf](Predicate)
* void {java11-javadoc}/java.base/java/util/List.html#replaceAll(java.util.function.UnaryOperator)[replaceAll](UnaryOperator)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#retainAll(java.util.Collection)[retainAll](Collection)
* def {java11-javadoc}/java.base/java/util/List.html#set(int,java.lang.Object)[set](int, def)
* int {java11-javadoc}/java.base/java/util/Collection.html#size()[size]()
* void {java11-javadoc}/java.base/java/util/List.html#sort(java.util.Comparator)[sort](Comparator)
* List split(Predicate)
* Spliterator {java11-javadoc}/java.base/java/util/Collection.html#spliterator()[spliterator]()
* Stream {java11-javadoc}/java.base/java/util/Collection.html#stream()[stream]()
* List {java11-javadoc}/java.base/java/util/List.html#subList(int,int)[subList](int, int)
* double sum()
* double sum(ToDoubleFunction)
* def[] {java11-javadoc}/java.base/java/util/Collection.html#toArray()[toArray]()
* def[] {java11-javadoc}/java.base/java/util/Collection.html#toArray(java.lang.Object%5B%5D)[toArray](def[])
* String {java11-javadoc}/java.base/java/lang/Object.html#toString()[toString]()


[[painless-api-reference-score-VectorScriptDocValues-SparseVectorScriptDocValues]]
==== VectorScriptDocValues.SparseVectorScriptDocValues
* boolean {java11-javadoc}/java.base/java/util/Collection.html#add(java.lang.Object)[add](def)
* void {java11-javadoc}/java.base/java/util/List.html#add(int,java.lang.Object)[add](int, def)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#addAll(java.util.Collection)[addAll](Collection)
* boolean {java11-javadoc}/java.base/java/util/List.html#addAll(int,java.util.Collection)[addAll](int, Collection)
* boolean any(Predicate)
* Collection asCollection()
* List asList()
* void {java11-javadoc}/java.base/java/util/Collection.html#clear()[clear]()
* List collect(Function)
* def collect(Collection, Function)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#contains(java.lang.Object)[contains](def)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#containsAll(java.util.Collection)[containsAll](Collection)
* def each(Consumer)
* def eachWithIndex(ObjIntConsumer)
* boolean {java11-javadoc}/java.base/java/util/List.html#equals(java.lang.Object)[equals](Object)
* boolean every(Predicate)
* def find(Predicate)
* List findAll(Predicate)
* def findResult(Function)
* def findResult(def, Function)
* List findResults(Function)
* void {java11-javadoc}/java.base/java/lang/Iterable.html#forEach(java.util.function.Consumer)[forEach](Consumer)
* def {java11-javadoc}/java.base/java/util/List.html#get(int)[get](int)
* Object getByPath(String)
* Object getByPath(String, Object)
* int getLength()
* Map groupBy(Function)
* int {java11-javadoc}/java.base/java/util/List.html#hashCode()[hashCode]()
* int {java11-javadoc}/java.base/java/util/List.html#indexOf(java.lang.Object)[indexOf](def)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#isEmpty()[isEmpty]()
* Iterator {java11-javadoc}/java.base/java/lang/Iterable.html#iterator()[iterator]()
* String join(String)
* int {java11-javadoc}/java.base/java/util/List.html#lastIndexOf(java.lang.Object)[lastIndexOf](def)
* ListIterator {java11-javadoc}/java.base/java/util/List.html#listIterator()[listIterator]()
* ListIterator {java11-javadoc}/java.base/java/util/List.html#listIterator(int)[listIterator](int)
* def {java11-javadoc}/java.base/java/util/List.html#remove(int)[remove](int)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#removeAll(java.util.Collection)[removeAll](Collection)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#removeIf(java.util.function.Predicate)[removeIf](Predicate)
* void {java11-javadoc}/java.base/java/util/List.html#replaceAll(java.util.function.UnaryOperator)[replaceAll](UnaryOperator)
* boolean {java11-javadoc}/java.base/java/util/Collection.html#retainAll(java.util.Collection)[retainAll](Collection)
* def {java11-javadoc}/java.base/java/util/List.html#set(int,java.lang.Object)[set](int, def)
* int {java11-javadoc}/java.base/java/util/Collection.html#size()[size]()
* void {java11-javadoc}/java.base/java/util/List.html#sort(java.util.Comparator)[sort](Comparator)
* List split(Predicate)
* Spliterator {java11-javadoc}/java.base/java/util/Collection.html#spliterator()[spliterator]()
* Stream {java11-javadoc}/java.base/java/util/Collection.html#stream()[stream]()
* List {java11-javadoc}/java.base/java/util/List.html#subList(int,int)[subList](int, int)
* double sum()
* double sum(ToDoubleFunction)
* def[] {java11-javadoc}/java.base/java/util/Collection.html#toArray()[toArray]()
* def[] {java11-javadoc}/java.base/java/util/Collection.html#toArray(java.lang.Object%5B%5D)[toArray](def[])
* String {java11-javadoc}/java.base/java/lang/Object.html#toString()[toString]()


4 changes: 0 additions & 4 deletions docs/reference/mapping/types.asciidoc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -46,8 +46,6 @@ string:: <<text,`text`>> and <<keyword,`keyword`>>

<<dense-vector>>:: Record dense vectors of float values.

<<sparse-vector>>:: Record sparse vectors of float values.

<<search-as-you-type>>:: A text-like field optimized for queries to implement as-you-type completion

<<alias>>:: Defines an alias to an existing field.
Expand Down Expand Up @@ -119,8 +117,6 @@ include::types/rank-features.asciidoc[]

include::types/search-as-you-type.asciidoc[]

include::types/sparse-vector.asciidoc[]

include::types/text.asciidoc[]

include::types/token-count.asciidoc[]
Expand Down
64 changes: 0 additions & 64 deletions docs/reference/mapping/types/sparse-vector.asciidoc
View file
Open in desktop

This file was deleted.

8 changes: 8 additions & 0 deletions docs/reference/migration/migrate_8_0/search.asciidoc
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,14 @@ The `nested_filter` and `nested_path` options, deprecated in 6.x, have been remo
`_search` and `_get` requests. Adaptive replica selection (activated by default in this version) will route requests
more efficiently using the service time of prior inter-node communications.

[float]
==== Removal of sparse vector fields
The `sparse_vector` field type was deprecated in 7.6 and is now removed in
8.0. We have not seen much interest in this experimental field type, and don't
see a clear use case as it's currently designed. If you have feedback or
suggestions around sparse vector functionality, please let us know through
GitHub or the 'discuss' forums.

[float]
==== Update to vector function signatures
The vector functions of the form `function(query, doc['field'])` were
Expand Down
Loading