Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Some connectors will pause based on queues threshold #6325

Closed
Jipegien opened this issue Mar 12, 2024 · 3 comments · Fixed by #7658
Closed

Some connectors will pause based on queues threshold #6325

Jipegien opened this issue Mar 12, 2024 · 3 comments · Fixed by #7658
Assignees
@aHenryJard @Megafredo @jborozco @helene-nguyen
Labels
feature use for describing a new feature to develop ingestion Linked to ingestion (manual, from file, feeds & queue) solved use to identify issue that has been solved (must be linked to the solving PR)
Milestone
Release 6.3.0

Comments

@Jipegien
Copy link
Member

Use case

As a platform admin, I sometimes need to stop connectors to relieve the worker queue. Currently, I am only able to do it by shutting down the entire docker of the connector, that is very cumbersome and cause multiple occasions to make mistakes.
@Jipegien Jipegien added the feature use for describing a new feature to develop label Mar 12, 2024
@Jipegien Jipegien added this to the Release 6.2.0 milestone Mar 12, 2024
@jborozco
Copy link
Member

jborozco commented Apr 4, 2024

This feature can include this issue #6558

@jborozco jborozco mentioned this issue Apr 4, 2024
Open
@SamuelHassine SamuelHassine added filigran team use to identify PR from the Filigran team and removed filigran team use to identify PR from the Filigran team labels Apr 20, 2024
@Kedae Kedae changed the title Ability to pause/unpause a connector from the UI Some connectors will pause based on queues threshold May 6, 2024
@aHenryJard aHenryJard self-assigned this May 6, 2024
@richard-julien
Copy link
Member

See #1161

@richard-julien richard-julien self-assigned this May 28, 2024
@Jipegien Jipegien modified the milestones: Release 6.2.0, Release 6.2.1 Jun 24, 2024
@richard-julien richard-julien removed their assignment Jun 28, 2024
@Jipegien Jipegien added the ingestion Linked to ingestion (manual, from file, feeds & queue) label Jul 1, 2024
@Kedae Kedae modified the milestones: Release 6.2.1, Release 6.3.0 Jul 2, 2024
@Megafredo Megafredo mentioned this issue Jul 10, 2024
Merged
5 tasks
@Megafredo Megafredo linked a pull request Jul 10, 2024 that will close this issue
[frontend/backend] Connector queuing auto backpressure (#6325) #7658
Merged
5 tasks
@aHenryJard aHenryJard mentioned this issue Jul 12, 2024
Merged
5 tasks
@jborozco
Copy link
Member

Will also include #7312

This was referenced Jul 16, 2024
Closed
Closed
Closed
Closed
Closed
@Megafredo Megafredo mentioned this issue Jul 24, 2024
Closed
4 tasks
Megafredo added a commit that referenced this issue Aug 5, 2024
@Megafredo @aHenryJard
@helene-nguyen @renovate
[frontend/backend] Connector queuing auto backpressure (#6325) (#7658)
8844831 
Co-authored-by: Angelique <[email protected]>
Co-authored-by: Helene Nguyen <[email protected]>
Co-authored-by: renovate[bot] <29139614+renovate[bot]@users.noreply.github.com>
@Megafredo Megafredo added the solved use to identify issue that has been solved (must be linked to the solving PR) label Aug 5, 2024
@helene-nguyen helene-nguyen mentioned this issue Aug 7, 2024
Merged
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@aHenryJard aHenryJard

@Megafredo Megafredo

@jborozco jborozco

@helene-nguyen helene-nguyen

Labels
feature use for describing a new feature to develop ingestion Linked to ingestion (manual, from file, feeds & queue) solved use to identify issue that has been solved (must be linked to the solving PR)
Projects
None yet
Milestone
Release 6.3.0
Development

Successfully merging a pull request may close this issue.

[frontend/backend] Connector queuing auto backpressure (#6325) OpenCTI-Platform/opencti
8 participants
@richard-julien @SamuelHassine @aHenryJard @Megafredo @jborozco @Kedae @helene-nguyen @Jipegien