Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Scheduling frequency #7

Closed
dirkgently007 opened this issue Jun 5, 2015 · 1 comment
Closed

Scheduling frequency #7

dirkgently007 opened this issue Jun 5, 2015 · 1 comment

Comments

@dirkgently007
Copy link

Is there a way to schedule jobs/dags on specific time of the day? Also, on a related note, can DAGs be scheduled on some other frequency - such as hourly, weekly etc?

Apologies if I missed it in the documentation.
@mistercrunch
Copy link
Member

Check out the DAG's schedule_interval parameter, it receives a python datetime.timedelta object:
http://pythonhosted.org/airflow/code.html#airflow.models.DAG

I believe at the moment heterogenous schedules within a DAG are not supported, but it should be easy to restore (used to work).

We tend to use sensors to wait for actual files to land in HDFS / S3 or partitions to land in Hive, but it's also possible to wait for a specific time using a TimeSensor, which shows up as any other node in the DAG. http://pythonhosted.org/airflow/code.html#airflow.operators.TimeSensor

@alexanderdean alexanderdean mentioned this issue Jun 14, 2015
Closed
@r39132 r39132 mentioned this issue Jun 22, 2015
Closed
aoen pushed a commit to aoen/incubator-airflow that referenced this issue Apr 10, 2020
@vshshjn7 @aoen
[EWT-7] 6607e48(airflow:master): [AIRFLOW-3160] Load latest_dagruns a…
63bae92 
…synchronously, speed up front page load time apache#4005 (apache#7)

* fb64f2e: [TWTR][AIRFLOW-XXX] Twitter Airflow Customizations + Fixup job scheduling without explicit_defaults_for_timestamp

* reformat

* 6607e48(airflow:master): [AIRFLOW-3160] Load latest_dagruns asynchronously, speed up front page load time apache#4005

* flake8 fix
@msumit msumit mentioned this issue Sep 11, 2020
Closed
mobuchowski pushed a commit to mobuchowski/airflow that referenced this issue Jan 4, 2022
@ashulmanWeWork
Add linter 2 (apache#7)
d8090fb 
* Adjust changes

* Formatting fixes

* Adjust to remove the requirements.txt file
mobuchowski pushed a commit to mobuchowski/airflow that referenced this issue Jan 4, 2022
@julienledem
Merge pull request apache#7 from OpenLineage/julienledem-related
12545eb 
Add a Related projects section.
@furquan39 furquan39 mentioned this issue Dec 14, 2023
Closed
2 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@mistercrunch @dirkgently007