AirbyteHook add cancel job option

[sivankumar86]

Apache Airflow Provider(s)

airbyte

Versions of Apache Airflow Providers

I want to cancel the job if it running more than specific time . Task is getting timeout however, airbyte job was not cancelled. it seems, on kill feature has not implemented

Workaround:
Create a custom operator and implement cancel hook and call it in on kill function.

def on_kill(self):
if (self.job_id):
self.log.error('on_kill: stopping airbyte Job %s',self.job_id)
self.hook.cancel_job(self.job_id)

Apache Airflow version

2.0.2

Operating System

Linux

Deployment

MWAA

Deployment details

Airflow 2.0.2

What happened

airbyte job was not cancelled upon timeout

What you think should happen instead

it should cancel the job

How to reproduce

Make sure job runs more than timeout

sync_source_destination = AirbyteTriggerSyncOperator(
task_id=f'airbyte_{key}',
airbyte_conn_id='airbyte_con',
connection_id=key,
asynchronous=False,
execution_timeout=timedelta(minutes=2)
)

Anything else

No response

Are you willing to submit PR?

• Yes I am willing to submit a PR!

Code of Conduct

• I agree to follow this project's Code of Conduct

[boring-cyborg]

Thanks for opening your first issue here! Be sure to follow the issue template!

[potiuk]

Feel free to add it! assigned you!

[sivankumar86]

Could you please review the change ?

#24593