Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a way to configure an OpenSearch distribution for the Elasticsearch DevService #34958

Merged

Conversation

marko-bekhta
Copy link
Contributor

@marko-bekhta marko-bekhta commented Jul 24, 2023

Fixes #23906

This was among the things Yoann suggested to look into. While doing so, I noticed that the guide had property placeholders instead of values -- fixed that.

Also, I wanted to better understand the logic behind the used Elasticsearch/OpenSearch image versions, but couldn't figure it out 😃 so any pointers are appreciated. elasticsearch-server.version version that we have in POM (7.16.3) and is used for testing doesn't match the default we have in the config for dev services (7.17.0) and the ES client is 8.8.2 (while 7.10.2 for proprietary components, which is expected). As for OpenSearch, opensearch-server.version is 1.2.3 while there's already a 2.8.0. At least, I'd expect that the version we are testing against and the version of dev services would match...

@quarkus-bot quarkus-bot bot added area/dependencies Pull requests that update a dependency file area/docstyle issues related for manual docstyle review area/documentation area/elasticsearch area/hibernate-search Hibernate Search labels Jul 24, 2023
@quarkus-bot
Copy link

quarkus-bot bot commented Jul 24, 2023

/cc @gsmet (elasticsearch,hibernate-search), @loicmathieu (elasticsearch), @yrodiere (elasticsearch,hibernate-search)

gsmet
gsmet previously requested changes Jul 24, 2023
Copy link
Member

@gsmet gsmet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Spotted a few minor things, otherwise that's great (but I will probably let Yoann have a look when he's back).

As for versions being a bit weird, it all boils down to us still supporting the old Elasticsearch high level client, but we should fix this soon hopefully: see #31997 .

@quarkus-bot

This comment has been minimized.

@marko-bekhta
Copy link
Contributor Author

Thanks for taking a look and for the link! 😃 I've addressed your suggestions, but will keep them locally for now, to not trigger more builds for now 😃

let Yoann have a look when he's back

yeah, I've also noticed the comments that we can only start the default backend, but couldn't think of anything obvious that would limit us from starting multiple instances, so wanted to check with Yoann on that too once he's back 😃

@yrodiere
Copy link
Member

yrodiere commented Aug 2, 2023

yeah, I've also noticed the comments that we can only start the default backend, but couldn't think of anything obvious that would limit us from starting multiple instances, so wanted to check with Yoann on that too once he's back smiley

See #24011, which has a few links that might explain the history of this limitation. I don't know from the top of my head why it's there. Maybe it was just the minimum viable product, and we never went beyond that.

Copy link
Member

@yrodiere yrodiere left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. I agree with Guillaume's comments, and added some of my own below.

@marko-bekhta marko-bekhta force-pushed the feat/i23906-opensearch-devservice branch from 17828c7 to 99a3ed5 Compare August 8, 2023 17:47
@github-actions
Copy link

github-actions bot commented Aug 8, 2023

🙈 The PR is closed and the preview is expired.

@quarkus-bot

This comment has been minimized.

Copy link
Member

@yrodiere yrodiere left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! The automatic resolution of Elasticsearch/OpenSearch will be a great addition.
A few comments on the implementation below.

@marko-bekhta marko-bekhta force-pushed the feat/i23906-opensearch-devservice branch from 99a3ed5 to c4005b5 Compare August 11, 2023 09:48
Copy link
Member

@yrodiere yrodiere left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

@yrodiere yrodiere dismissed gsmet’s stale review August 11, 2023 10:48

Comments were addressed

@quarkus-bot

This comment has been minimized.

@yrodiere yrodiere force-pushed the feat/i23906-opensearch-devservice branch from c4005b5 to 084f57f Compare August 14, 2023 14:49
@yrodiere yrodiere added the triage/waiting-for-ci Ready to merge when CI successfully finishes label Aug 14, 2023
@quarkus-bot

This comment has been minimized.

@yrodiere
Copy link
Member

Ok that's a new one:

2023-08-14T17:15:52.0868161Z [ERROR] Tests run: 10, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 10.34 s <<< FAILURE! -- in io.quarkus.hibernate.orm.multiplepersistenceunits.MultiplePersistenceUnitsCdiEntityManagerTest
2023-08-14T17:15:52.0875976Z [ERROR] io.quarkus.hibernate.orm.multiplepersistenceunits.MultiplePersistenceUnitsCdiEntityManagerTest.usersEntityManagerInRequestNoTransaction -- Time elapsed: 6.022 s <<< FAILURE!
2023-08-14T17:15:52.0876971Z java.lang.AssertionError:
2023-08-14T17:15:52.0877941Z
2023-08-14T17:15:52.0878281Z Expecting code not to raise a throwable but caught
2023-08-14T17:15:52.0878708Z "java.lang.OutOfMemoryError: Metaspace

I'll don't see how that would be caused by this PR though... I'll ask around.

@gsmet gsmet force-pushed the feat/i23906-opensearch-devservice branch from 084f57f to cd90a56 Compare August 19, 2023 07:57
@gsmet
Copy link
Member

gsmet commented Aug 19, 2023

I rebased to get at least one JVM build green.

@quarkus-bot
Copy link

quarkus-bot bot commented Aug 19, 2023

Failing Jobs - Building cd90a56

Status Name Step Failures Logs Raw logs
✔️ JVM Tests - JDK 11
✔️ JVM Tests - JDK 17
JVM Tests - JDK 17 Windows Build ⚠️ Check → Logs Raw logs
JVM Tests - JDK 20 Build ⚠️ Check → Logs Raw logs

@yrodiere yrodiere merged commit 0f6df38 into quarkusio:main Aug 21, 2023
@quarkus-bot quarkus-bot bot added kind/enhancement New feature or request and removed triage/waiting-for-ci Ready to merge when CI successfully finishes labels Aug 21, 2023
@quarkus-bot quarkus-bot bot added this to the 3.4 - main milestone Aug 21, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/dependencies Pull requests that update a dependency file area/docstyle issues related for manual docstyle review area/documentation area/elasticsearch area/hibernate-search Hibernate Search kind/enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

OpenSearch dev-services
3 participants