Source Marketo - rework read retry #14149
Assignees
Labels
Comments
davydov-d
added
connectors/source/marketo
team/connectors-python
type/bug
|
It looks like this item has already been estimated. If the estimate holds, we can move it forward to backlog (Scope). |
|
@YowanR I'm going to include this in a certification scope if you're ok with that. Please let me know otherwise |
|
@davydov-d Can you clarify what you mean by "include this in a certification scope" ? Thanks! |
|
Yes, that works for me -- thanks! @davydov-d |
davydov-d
added a commit
that referenced
this issue
Aug 16, 2022
davydov-d
added a commit
that referenced
this issue
Aug 16, 2022
davydov-d
added a commit
that referenced
this issue
Aug 16, 2022
davydov-d
added a commit
that referenced
this issue
Aug 17, 2022
* #14149 source marketo: retry job creation instead of skipping * #14149 source marketo: upd changelog * #14149 source marketo: increase timeouts for SATs * auto-bump connector version [ci skip] Co-authored-by: Octavia Squidington III <[email protected]>
rodireich
pushed a commit
that referenced
this issue
Aug 25, 2022
* #14149 source marketo: retry job creation instead of skipping * #14149 source marketo: upd changelog * #14149 source marketo: increase timeouts for SATs * auto-bump connector version [ci skip] Co-authored-by: Octavia Squidington III <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Issue 9332 demonstrates the connector has a problem creating an async job for further fetching the results. Ideally this should be retried but it is currently impossible cause jobs are created in
stream_slicesmethod which is not retriable. So we need to move creating jobs somewhere they can be re-created in case of failure.As for now the jobs that failed to create are skipped. This can not be a long term solution because it means losing data
The text was updated successfully, but these errors were encountered: