Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fleet / Osquery Manager: Can not upgrade package - concurrent installation detected #153212

Closed
ceeeekay opened this issue Mar 14, 2023 · 7 comments
Labels
bug Fixes for quality problems that affect the customer experience Team:Fleet Team label for Observability Data Collection Fleet team

Comments

@ceeeekay
Copy link

ceeeekay commented Mar 14, 2023

Kibana version: 8.6.2

Elasticsearch version: 8.6.2

Package registry Docker image: 8.6.2

Server OS version: Ubuntu 22.04.2

Browser version: na

Browser OS version: n/a

Original install method (e.g. download page, yum, from source, etc.): apt

Describe the bug: I have an air-gapped install using the Elastic Docker image for the Fleet package registry. The Docker container is running on the same node as Kibana. I'm able to browse and install integrations from the locally hosted registry.

However, In the settings page for the Osquery Manager integration it's stuck on 1.5.1 and is claiming there is a 1.6.0 upgrade available, but the upgrade button is just spinning its wheel endlessly (as in, it's been like this for weeks). Other integrations can be upgraded with no problem. As far as I can tell it's only the Osquery integration which has this issue.

Steps to reproduce:
I'm unsure exactly how to reproduce this as I have no idea how it got into this condition.

Expected behavior:
Osquery integration upgrade button should be clickable and no errors in the logs.

Screenshots (if relevant):
Oqsuery integration will not upgrade
Screenshot 2023-03-13 at 11 48 17 AM

Other integrations are fine
Screenshot 2023-03-13 at 12 10 53 PM

Errors in browser console (if relevant): n/a

Provide logs and/or server output (if relevant):
[2023-03-15T11:54:14.640+13:00][WARN ][plugins.fleet] large amount of default fields detected for index template logs-osquery_manager.result in package osquery_manager, applying the first 1024 fields
[2023-03-15T11:54:17.503+13:00][WARN ][plugins.fleet] Failure to install package [osquery_manager]: [ConcurrentInstallOperationError: Concurrent installation or upgrade of osquery_manager-1.6.0 detected, aborting. Original error: Saved object [tag/fleet-managed-kelp-admin] conflict]
[2023-03-15T11:54:17.877+13:00][INFO ][plugins.osquery] Updating osquery_manager integration
[2023-03-15T11:54:17.906+13:00][WARN ][plugins.fleet] Failure to install package [osquery_manager]: [ConcurrentInstallOperationError: Concurrent installation or upgrade of osquery_manager-1.6.0 detected, aborting.]
[2023-03-15T11:54:17.907+13:00][INFO ][plugins.osquery] osquery_manager integration updated

@ceeeekay ceeeekay added the bug Fixes for quality problems that affect the customer experience label Mar 14, 2023
@botelastic botelastic bot added the needs-team Issues missing a team label label Mar 14, 2023
@jsanz jsanz added the Team:Integrations Team Label for Observability Integrations team label Mar 23, 2023
@botelastic botelastic bot removed the needs-team Issues missing a team label label Mar 23, 2023
@ceeeekay
Copy link
Author

Hi there, just confirming this is still an issue in Kibana 8.7.0

Osquery 1.7.2 upgrade shows as available but it's not selectable in the integrations interface.

Kibana log errors are the same as those in 8.6.2, above.

@jen-huang jen-huang added Team:Fleet Team label for Observability Data Collection Fleet team and removed Team:Integrations Team Label for Observability Integrations team labels Apr 6, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/fleet (Team:Fleet)

@matthiasledergerber
Copy link

I can confirm we still have this issue on Elastic-Stack 8.8.1. We have several Kibana Spaces but use the integration just in one space. However, under saved objects in each space its a complete mess. There are several objects, some old some new but all from the Windows or System integration. I'm currently trying to delete objects in all spaces but the integration is appearing everywhere again and its a pain to fix this.

We have 2 kibana and 7 elasticsearch nodes. Not sure where this issue comes from i dont suspect manual intervention but more an issue while upgraing the nodes or the integration.

some logs inform about Error: Non-unique import objects detected

{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.6.1"},"@timestamp":"2023-06-23T17:16:23.097+02:00","message":"Failure to install package [windows]: [Error: Non-unique import objects detected: [dashboard:windows-c77e06c0-9e7c-11ea-af6f-cfdb1ee1d6c8,dashboard:windows-d9eba730-c991-11e7-9835-2f31fe08873b,visualization:windows-1eeaaf70-9f23-11ea-bef1-95118e62a7c1,visualization:windows-23a5fff0-c98e-11e7-9835-2f31fe08873b,visualization:windows-2dbabdf0-9f29-11ea-bef1-95118e62a7c1,visualization:windows-35f5ad60-c996-11e7-9835-2f31fe08873b,visualization:windows-3e55daa0-9e8e-11ea-af6f-cfdb1ee1d6c8,visualization:windows-52543ef0-9e95-11ea-af6f-cfdb1ee1d6c8,visualization:windows-70751050-9f33-11ea-bef1-95118e62a7c1,visualization:windows-78874900-9f30-11ea-bef1-95118e62a7c1,visualization:windows-7adbce50-9e96-11ea-af6f-cfdb1ee1d6c8,visualization:windows-7f3e7710-9e94-11ea-af6f-cfdb1ee1d6c8,visualization:windows-830c45f0-c991-11e7-9835-2f31fe08873b,visualization:windows-92a2a6b0-9f29-11ea-bef1-95118e62a7c1,visualization:windows-9ec52c30-9e91-11ea-af6f-cfdb1ee1d6c8,visualization:windows-b0c5d570-9e7c-11ea-af6f-cfdb1ee1d6c8,visualization:windows-c0945210-9e8b-11ea-af6f-cfdb1ee1d6c8,visualization:windows-c36b2ba0-ca29-11e7-9835-2f31fe08873b,visualization:windows-d27dea70-9f32-11ea-bef1-95118e62a7c1,visualization:windows-e20b3940-9e9a-11ea-af6f-cfdb1ee1d6c8,visualization:windows-e64ff750-9f28-11ea-bef1-95118e62a7c1,visualization:windows-eb8277d0-c98c-11e7-9835-2f31fe08873b,visualization:windows-f9fa55f0-9f34-11ea-bef1-95118e62a7c1,visualization:windows-fbb025e0-9e7c-11ea-af6f-cfdb1ee1d6c8,search:windows-11a61760-9f27-11ea-bef1-95118e62a7c1,search:windows-b6b7ccc0-c98d-11e7-9835-2f31fe08873b]]","log":{"level":"WARN","logger":"plugins.fleet"},"process":{"pid":79289},"trace":{"id":"8f731070ea7d56575691d358809b8293"},"transaction":{"id":"ed1383061e85ddb9"}} {"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.6.1"},"@timestamp":"2023-06-23T17:16:23.098+02:00","message":"uninstalling windows-1.24.0 after error installing: [Error: Non-unique import objects detected: [dashboard:windows-c77e06c0-9e7c-11ea-af6f-cfdb1ee1d6c8,dashboard:windows-d9eba730-c991-11e7-9835-2f31fe08873b,visualization:windows-1eeaaf70-9f23-11ea-bef1-95118e62a7c1,visualization:windows-23a5fff0-c98e-11e7-9835-2f31fe08873b,visualization:windows-2dbabdf0-9f29-11ea-bef1-95118e62a7c1,visualization:windows-35f5ad60-c996-11e7-9835-2f31fe08873b,visualization:windows-3e55daa0-9e8e-11ea-af6f-cfdb1ee1d6c8,visualization:windows-52543ef0-9e95-11ea-af6f-cfdb1ee1d6c8,visualization:windows-70751050-9f33-11ea-bef1-95118e62a7c1,visualization:windows-78874900-9f30-11ea-bef1-95118e62a7c1,visualization:windows-7adbce50-9e96-11ea-af6f-cfdb1ee1d6c8,visualization:windows-7f3e7710-9e94-11ea-af6f-cfdb1ee1d6c8,visualization:windows-830c45f0-c991-11e7-9835-2f31fe08873b,visualization:windows-92a2a6b0-9f29-11ea-bef1-95118e62a7c1,visualization:windows-9ec52c30-9e91-11ea-af6f-cfdb1ee1d6c8,visualization:windows-b0c5d570-9e7c-11ea-af6f-cfdb1ee1d6c8,visualization:windows-c0945210-9e8b-11ea-af6f-cfdb1ee1d6c8,visualization:windows-c36b2ba0-ca29-11e7-9835-2f31fe08873b,visualization:windows-d27dea70-9f32-11ea-bef1-95118e62a7c1,visualization:windows-e20b3940-9e9a-11ea-af6f-cfdb1ee1d6c8,visualization:windows-e64ff750-9f28-11ea-bef1-95118e62a7c1,visualization:windows-eb8277d0-c98c-11e7-9835-2f31fe08873b,visualization:windows-f9fa55f0-9f34-11ea-bef1-95118e62a7c1,visualization:windows-fbb025e0-9e7c-11ea-af6f-cfdb1ee1d6c8,search:windows-11a61760-9f27-11ea-bef1-95118e62a7c1,search:windows-b6b7ccc0-c98d-11e7-9835-2f31fe08873b]]","log":{"level":"ERROR","logger":"plugins.fleet"},"process":{"pid":79289},"trace":{"id":"8f731070ea7d56575691d358809b8293"},"transaction":{"id":"ed1383061e85ddb9"}}

other interesting log is:

{"service":{"node":{"roles":["background_tasks","ui"]}},"ecs":{"version":"8.6.1"},"@timestamp":"2023-06-23T17:54:39.403+02:00","message":"Failure to install package [windows]: [ConcurrentInstallOperationError: Concurrent installation or upgrade of windows-1.24.0 detected, aborting. Original error: Saved object [tag/fleet-pkg-windows-default] conflict]","log":{"level":"WARN","logger":"plugins.fleet"},"process":{"pid":99977},"span":{"id":"e0990bc91123c7ba"},"trace":{"id":"52e5a93bb4e0e4a7eeca537541c39fe5"}}

@juliaElastic
Copy link
Contributor

Related to #161804

@criamico
Copy link
Contributor

criamico commented Nov 28, 2023

This is similar to #171986.

@criamico criamico self-assigned this Jan 29, 2024
@criamico
Copy link
Contributor

As the error was

[ConcurrentInstallOperationError: Concurrent installation or upgrade of osquery_manager-1.6.0 detected, aborting. Original error: Saved object [tag/fleet-managed-kelp-admin] conflict]

This seems to be another instance of #171986 and should be fixed with #173190. @kpollich do you think we can close it?

@criamico criamico removed their assignment Jan 29, 2024
@nchaulet
Copy link
Member

nchaulet commented Feb 2, 2024

This seems to be another instance of #171986 and should be fixed with #173190. @kpollich do you think we can close it?

Yes it seems to me it was a conflict on tag saved object, that should be fixed by @kpollich PR. I will close it and we can reopen it, if it happen again.

@nchaulet nchaulet closed this as completed Feb 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Fixes for quality problems that affect the customer experience Team:Fleet Team label for Observability Data Collection Fleet team
Projects
None yet
Development

No branches or pull requests

8 participants