From 7f72d74f23698770d4dfd0f428a416bfedc21191 Mon Sep 17 00:00:00 2001 From: "opensearch-trigger-bot[bot]" <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> Date: Wed, 3 Jan 2024 21:44:27 -0800 Subject: [PATCH] Updated OpenSearch Lucene snapshot location (#1832) (#1834) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit * Backport multiple PRs to main from 2.x (#1652) * fix parameter name in preprocess function; fix remote model function … (#1362) * fix parameter name in preprocess function; fix remote model function name Signed-off-by: Yaliang Wu * fix failed unit test Signed-off-by: Yaliang Wu --------- Signed-off-by: Yaliang Wu * throw exception when model group not found during update request (#1447) Signed-off-by: Bhavana Ramaram * add status code to model tensor (#1443) (#1453) Signed-off-by: Yaliang Wu * register new versions to a model group based on the name provided (#1452) Signed-off-by: Bhavana Ramaram * fixing metrics correlation algorithm (#1448) * fixing metrics correlation algorithm Signed-off-by: Dhrubo Saha * if model version fails to register, update model group accordingly (#1463) * if model version fails to register, update model group accordingly Signed-off-by: Bhavana Ramaram * Update Model API (#1350) * Update Model API POC Signed-off-by: Sicheng Song * Using GetRequest to get model Signed-off-by: Sicheng Song * Finalize model update API Signed-off-by: Sicheng Song * Fix compile Signed-off-by: Sicheng Song * Fix compileTest Signed-off-by: Sicheng Song * Add Unit Test Cases for Update Model API Signed-off-by: Sicheng Song * Tune back test coverage thereshold Signed-off-by: Sicheng Song * Add more unit tests on Update model API Signed-off-by: Sicheng Song * Add unit test for TransportUpdateModelAction class Signed-off-by: Sicheng Song * Fix a test error Signed-off-by: Sicheng Song * Change exception thrown to failure response Signed-off-by: Sicheng Song * Move the function judgement to the outter block Signed-off-by: Sicheng Song * Check if model is undeployed before update model Signed-off-by: Sicheng Song * Add more unit test for update model API Signed-off-by: Sicheng Song * Fix unit test due to blocking java 11 CI workflow Signed-off-by: Sicheng Song * Enabling auto bumping model version during registering to a new model group and address reviewers' other concern Signed-off-by: Sicheng Song * Autobump new model groups' latest version when register to a new model Signed-off-by: Sicheng Song * Change the REST API method from POST to PUT Signed-off-by: Sicheng Song * Change the update REST API endpoint Signed-off-by: Sicheng Song --------- Signed-off-by: Sicheng Song * Add a setting to control the update connector API (#1465) * Add a setting to control the update connector API Signed-off-by: Sicheng Song * Enabling the update connnector setting in unit test Signed-off-by: Sicheng Song * Enabling the update connnector setting in corresponding unit test Signed-off-by: Sicheng Song --------- Signed-off-by: Sicheng Song * fix update connector API (#1484) * fix update connector API Signed-off-by: Yaliang Wu * Performance enhacement for predict action by caching model info (#1472) (#1508) * Performance enhacement for predict action by caching model info Signed-off-by: zane-neo * Add context.restore() to avoid missing info Signed-off-by: zane-neo --------- Signed-off-by: zane-neo (cherry picked from commit a985f6ec6dc280072b7045dcf4851959aa575c54) Co-authored-by: zane-neo * fix failed ut from PR 1472 (#1479) (#1510) * fix failed ut from PR 1472 Signed-off-by: Yaliang Wu * exclude class for low coverage Signed-off-by: Yaliang Wu --------- Signed-off-by: Yaliang Wu (cherry picked from commit da5d82942385c34544016cf361b517c2bb3d36c4) Co-authored-by: Yaliang Wu * [Backport to 2.11] throw exception if remote model doesn't return 2xx status code; fix p… (#1477) (#1509) * throw exception if remote model doesn't return 2xx status code; fix p… (#1473) * throw exception if remote model doesn't return 2xx status code; fix predict runner Signed-off-by: Yaliang Wu * fix kmeans model deploy bug Signed-off-by: Yaliang Wu * support multiple docs for remote embedding model Signed-off-by: Yaliang Wu * fix ut Signed-off-by: Yaliang Wu --------- Signed-off-by: Yaliang Wu * fix wrong class Signed-off-by: Yaliang Wu --------- Signed-off-by: Yaliang Wu (cherry picked from commit 201c8a89b07126c5da9ed2e743c7f1b0e4806e12) Co-authored-by: Yaliang Wu * fix no worker node exception for remote embedding model (#1482) (#1511) * fix no worker node exception for remote embedding model Signed-off-by: Yaliang Wu * only add model info to cache if model cache exist Signed-off-by: Yaliang Wu --------- Signed-off-by: Yaliang Wu (cherry picked from commit 6f83b9fee002026d7a8d0fa3550fe8cf80b30371) Co-authored-by: Yaliang Wu * fix for delete model group API throwing incorrect error when model index not created (#1485) (#1486) (#1512) * fix for delete model group API throwing incorrect error when model index not created Signed-off-by: Bhavana Ramaram (cherry picked from commit 60ef0fd6dfeda18729f1dc2ec6ea9c0418c6ff69) Co-authored-by: Bhavana Ramaram (cherry picked from commit 55446819b7686e14cf9e1d10edf7956ed57148c7) Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> * fix no worker node error on multi-node cluster (#1487) (#1513) Signed-off-by: Yaliang Wu (cherry picked from commit cea1cd675cd95e37c29a3bd88c1cd9d58e81b20a) Co-authored-by: Yaliang Wu * add prefix to show the error is from remote service (#1499) (#1515) Signed-off-by: Yaliang Wu (cherry picked from commit 3897ad179437e683033d6918ebb6b4edf439dd4d) Co-authored-by: Yaliang Wu * fix multiple docs support (#1516) Signed-off-by: Yaliang Wu * adding another fix issue to the release note (#1498) (#1514) Signed-off-by: Dhrubo Saha (cherry picked from commit 440155c5c242113cd264b59818d1927b498c1480) Co-authored-by: Dhrubo Saha * add bedrockURL to trusted connector regex list (#1461) Signed-off-by: Bhavana Ramaram * return parsing exception 400 for parsing errors Signed-off-by: Xun Zhang * add more ut in restupdateconnector Signed-off-by: Xun Zhang * fix format violations Signed-off-by: Bhavana Ramaram * Fix model/connector update API to address security concern (#1595) * Fix model/connector update API to address appsec concern Signed-off-by: Sicheng Song * Fix compile and build failure Signed-off-by: Sicheng Song * Improve unit test coverage Signed-off-by: Sicheng Song * Fix spotless Signed-off-by: Sicheng Song * Merge update connector feature flag to remote inference feature flag Signed-off-by: Sicheng Song * Fix compile Signed-off-by: Sicheng Song * Fix exception status Signed-off-by: Sicheng Song * Keep fixing exception status Signed-off-by: Sicheng Song * Spotless fix Signed-off-by: Sicheng Song * Add UT on parsing exception Signed-off-by: Sicheng Song --------- Signed-off-by: Sicheng Song * change XContentFactory to MediaTypeRegistry builder in MLRegisterModelInputTest class Signed-off-by: Bhavana Ramaram --------- Signed-off-by: Yaliang Wu Signed-off-by: Bhavana Ramaram Signed-off-by: Dhrubo Saha Signed-off-by: Sicheng Song Signed-off-by: Xun Zhang Co-authored-by: Yaliang Wu Co-authored-by: Dhrubo Saha Co-authored-by: Sicheng Song Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> Co-authored-by: zane-neo Co-authored-by: Xun Zhang * Updated OpenSearch Lucene snapshot location Signed-off-by: Owais Kazi --------- Signed-off-by: Yaliang Wu Signed-off-by: Bhavana Ramaram Signed-off-by: Dhrubo Saha Signed-off-by: Sicheng Song Signed-off-by: Xun Zhang Signed-off-by: Owais Kazi Co-authored-by: Bhavana Ramaram Co-authored-by: Yaliang Wu Co-authored-by: Dhrubo Saha Co-authored-by: Sicheng Song Co-authored-by: opensearch-trigger-bot[bot] <98922864+opensearch-trigger-bot[bot]@users.noreply.github.com> Co-authored-by: zane-neo Co-authored-by: Xun Zhang (cherry picked from commit 8352e69ae4edd2b615933ff2947d61d1d9546740) Co-authored-by: Owais Kazi --- build-tools/repositories.gradle | 2 +- build.gradle | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/build-tools/repositories.gradle b/build-tools/repositories.gradle index e72fc8a8cc..3156602830 100644 --- a/build-tools/repositories.gradle +++ b/build-tools/repositories.gradle @@ -8,5 +8,5 @@ repositories { maven { url "https://aws.oss.sonatype.org/content/repositories/snapshots" } mavenCentral() maven {url 'https://oss.sonatype.org/content/repositories/snapshots/'} - maven { url "https://d1nvenhzbhpy0q.cloudfront.net/snapshots/lucene/" } + maven { url "https://artifacts.opensearch.org/snapshots/lucene/" } } \ No newline at end of file diff --git a/build.gradle b/build.gradle index c2c1d9ef74..b2d02ed75a 100644 --- a/build.gradle +++ b/build.gradle @@ -30,7 +30,7 @@ buildscript { maven { url "https://aws.oss.sonatype.org/content/repositories/snapshots" } mavenCentral() maven { url "https://plugins.gradle.org/m2/" } - maven { url "https://d1nvenhzbhpy0q.cloudfront.net/snapshots/lucene/" } + maven { url "https://artifacts.opensearch.org/snapshots/lucene/" } } dependencies {