Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[AUTOCUT] Distribution Build Failed for neural-search-3.0.0 #830

Closed
opensearch-ci-bot opened this issue Jul 11, 2024 · 29 comments
Closed

[AUTOCUT] Distribution Build Failed for neural-search-3.0.0 #830

opensearch-ci-bot opened this issue Jul 11, 2024 · 29 comments
Labels
autocut Created by automated workflow v3.0.0 v3.0.0

Comments

@opensearch-ci-bot
Copy link
Collaborator

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10048/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot opensearch-ci-bot added autocut Created by automated workflow untriaged v3.0.0 v3.0.0 labels Jul 11, 2024
@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10053/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10058/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10061/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10064/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10067/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10068/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10072/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10083/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10090/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10096/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10099/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10101/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10111/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10116/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10118/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10121/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10123/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@martin-gaievski
Copy link
Member

neural search is failing because knn has failied and we refer to it as downstream dependency:

2024-07-26 02:03:28 INFO     Executing "git init" in /tmp/tmp60fvx21g/neural-search
2024-07-26 02:03:28 INFO     Executing "git remote add origin https://github.com/opensearch-project/neural-search.git" in /tmp/tmp60fvx21g/neural-search
2024-07-26 02:03:28 INFO     Executing "git fetch --depth 1 origin main" in /tmp/tmp60fvx21g/neural-search
2024-07-26 02:03:29 INFO     Executing "git checkout FETCH_HEAD" in /tmp/tmp60fvx21g/neural-search
2024-07-26 02:03:29 INFO     Executing "git rev-parse HEAD" in /tmp/tmp60fvx21g/neural-search
2024-07-26 02:03:29 INFO     Checked out https://github.com/opensearch-project/neural-search.git@main into /tmp/tmp60fvx21g/neural-search at 1f2749161021a0c4c09b32f10b96bfc7e870503c
2024-07-26 02:03:29 INFO     Executing "bash /var/jenkins/workspace/distribution-build-opensearch/scripts/default/opensearch/build.sh -v 3.0.0 -p linux -a arm64 -s false -o builds" in /tmp/tmp60fvx21g/neural-search
+ getopts :h:v:q:s:o:p:a: arg
+ case $arg in
+ VERSION=3.0.0
+ getopts :h:v:q:s:o:p:a: arg
+ case $arg in
+ PLATFORM=linux
+ getopts :h:v:q:s:o:p:a: arg
+ case $arg in
+ ARCHITECTURE=arm64
+ getopts :h:v:q:s:o:p:a: arg
+ case $arg in
+ SNAPSHOT=false
+ getopts :h:v:q:s:o:p:a: arg
+ case $arg in
+ OUTPUT=builds
+ getopts :h:v:q:s:o:p:a: arg
+ '[' -z 3.0.0 ']'
+ [[ ! -z '' ]]
+ [[ false == \t\r\u\e ]]
+ '[' -z builds ']'
+ mkdir -p builds
+ ./gradlew assemble --no-daemon --refresh-dependencies -DskipTests=true -Dopensearch.version=3.0.0 -Dbuild.snapshot=false -Dbuild.version_qualifier=
To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.9/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.
Daemon will be stopped at the end of the build 

> Configure project :
Invalid Java installation found at '/usr/lib/jvm/temurin-8-jdk-amd64' (Java home). It will be re-checked in the next build. This might have performance impact if it keeps failing. Run the 'javaToolchains' task for more details.
Invalid Java installation found at '/usr/lib/jvm/temurin-11-jdk-amd64' (Java home). It will be re-checked in the next build. This might have performance impact if it keeps failing. Run the 'javaToolchains' task for more details.
Invalid Java installation found at '/usr/lib/jvm/adoptopenjdk-14-amd64' (Java home). It will be re-checked in the next build. This might have performance impact if it keeps failing. Run the 'javaToolchains' task for more details.

FAILURE: Build failed with an exception.

* Where:
Build file '/tmp/tmp60fvx21g/neural-search/build.gradle' line: 281

* What went wrong:
A problem occurred evaluating root project 'neural-search'.
> Could not resolve all files for configuration ':zipArchive'.
   > Could not find org.opensearch.plugin:opensearch-knn:3.0.0.0.
     Searched in the following locations:
       - https://repo.maven.apache.org/maven2/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom
       - file:/home/ci-runner/.m2/repository/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom
       - https://aws.oss.sonatype.org/content/repositories/snapshots/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom
       - https://plugins.gradle.org/m2/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom
     Required by:
         project :

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
> Get more help at https://help.gradle.org.

Deprecated Gradle features were used in this build, making it incompatible with Gradle 9.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

For more on this, please refer to https://docs.gradle.org/8.9/userguide/command_line_interface.html#sec:command_line_warnings in the Gradle documentation.

BUILD FAILED in 15s
2024-07-26 02:03:44 ERROR    ERROR: Command 'bash /var/jenkins/workspace/distribution-build-opensearch/scripts/default/opensearch/build.sh -v 3.0.0 -p linux -a arm64 -s false -o builds' returned non-zero exit status 1.
2024-07-26 02:03:44 ERROR    Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10125/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10126/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10127/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10129/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10133/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10135/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@dblock
Copy link
Member

dblock commented Aug 1, 2024

Could maintainers please take a look? Coming from opensearch-project/opensearch-api-specification#459 currently neural search is not included in 3.0 builds it looks like.

Maybe @zhichao-aws or @jmazanec15?

OpenSearch 3.0.0

[INFO] => PUT /_ingest/pipeline/books_pipeline ({}) [application/json] | {
  "description": "Extracts text from field and embeds it.",
  "processors": [
    {
      "text_embedding": {
        "model_id": "text-embedding-model",
        "field_map": {
          "text": "passage_embedding"
        }
      }
    }
  ]
}
[INFO] <= 400 (application/json) | {
  "root_cause": [
    {
      "type": "parse_exception",
      "reason": "No processor type exists with name [text_embedding]",
      "processor_type": "text_embedding"
    }
  ],
  "type": "parse_exception",
  "reason": "No processor type exists with name [text_embedding]",
  "processor_type": "text_embedding"
}

@jmazanec15
Copy link
Member

Appears that k-NN is not present. opensearch-project/k-NN#1816. Will look over there.

+ ./gradlew assemble --no-daemon --refresh-dependencies -DskipTests=true -Dopensearch.version=3.0.0 -Dbuild.snapshot=false -Dbuild.version_qualifier=

To honour the JVM settings for this build a single-use Daemon process will be forked. For more on this, please refer to https://docs.gradle.org/8.9/userguide/gradle_daemon.html#sec:disabling_the_daemon in the Gradle documentation.

Daemon will be stopped at the end of the build 


> Configure project :

Invalid Java installation found at '/usr/lib/jvm/temurin-8-jdk-amd64' (Java home). It will be re-checked in the next build. This might have performance impact if it keeps failing. Run the 'javaToolchains' task for more details.

Invalid Java installation found at '/usr/lib/jvm/temurin-11-jdk-amd64' (Java home). It will be re-checked in the next build. This might have performance impact if it keeps failing. Run the 'javaToolchains' task for more details.

Invalid Java installation found at '/usr/lib/jvm/adoptopenjdk-14-amd64' (Java home). It will be re-checked in the next build. This might have performance impact if it keeps failing. Run the 'javaToolchains' task for more details.


FAILURE: Build failed with an exception.


* Where:

Build file '/tmp/tmp0hqkrgvp/flow-framework/build.gradle' line: 378


* What went wrong:

A problem occurred evaluating root project 'opensearch-flow-framework'.

> Could not resolve all files for configuration ':zipArchive'.

   > Could not find org.opensearch.plugin:opensearch-knn:3.0.0.0.

     Searched in the following locations:

       - https://repo.maven.apache.org/maven2/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom

       - file:/home/ci-runner/.m2/repository/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom

       - https://aws.oss.sonatype.org/content/repositories/snapshots/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom

       - https://plugins.gradle.org/m2/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom

     Required by:

         project :

   > Could not find org.opensearch.plugin:neural-search:3.0.0.0.

     Searched in the following locations:

       - https://repo.maven.apache.org/maven2/org/opensearch/plugin/neural-search/3.0.0.0/neural-search-3.0.0.0.pom

       - file:/home/ci-runner/.m2/repository/org/opensearch/plugin/neural-search/3.0.0.0/neural-search-3.0.0.0.pom

       - https://aws.oss.sonatype.org/content/repositories/snapshots/org/opensearch/plugin/neural-search/3.0.0.0/neural-search-3.0.0.0.pom

       - https://plugins.gradle.org/m2/org/opensearch/plugin/neural-search/3.0.0.0/neural-search-3.0.0.0.pom

     Required by:

         project :

@jmazanec15
Copy link
Member


FAILURE: Build failed with an exception.

* Where:
Build file '/tmp/tmpmgjziz64/neural-search/build.gradle' line: 281

* What went wrong:
A problem occurred evaluating root project 'neural-search'.
> Could not resolve all files for configuration ':zipArchive'.
   > Could not find org.opensearch.plugin:opensearch-knn:3.0.0.0.
     Searched in the following locations:
       - https://repo.maven.apache.org/maven2/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom
       - file:/home/ci-runner/.m2/repository/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom
       - https://aws.oss.sonatype.org/content/repositories/snapshots/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom
       - https://plugins.gradle.org/m2/org/opensearch/plugin/opensearch-knn/3.0.0.0/opensearch-knn-3.0.0.0.pom
     Required by:
         project :

@opensearch-ci-bot
Copy link
Collaborator Author

Received Error: Error building neural-search, retry with: ./build.sh manifests/3.0.0/opensearch-3.0.0.yml --component neural-search.
neural-search failed during the distribution build for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10139/display/redirect.
The failed build stage will be marked as unstable(!). Please see ./build.sh step for more details

@opensearch-ci-bot
Copy link
Collaborator Author

Closing the issue as the distribution build for neural-search has passed for version: 3.0.0.
Please see build log at https://build.ci.opensearch.org/job/distribution-build-opensearch/10143/display/redirect

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
autocut Created by automated workflow v3.0.0 v3.0.0
Projects
None yet
Development

No branches or pull requests

4 participants