Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use Luigi? #152

Closed
averagehat opened this issue Jul 24, 2015 · 1 comment
Closed

Use Luigi? #152

averagehat opened this issue Jul 24, 2015 · 1 comment

Comments

@averagehat
Copy link
Contributor

Luigi might make it easier to handle making overall pipeline changes like
#110 or #150

Also will allow automatic checkpointing, diagram construction, and allows stages to be run in chunks/independently.

Edit: An initial implementation might just be to wrap each script call in runsample.py in a luigi task.
Related: http://ratatosk.readthedocs.org/en/latest/dev/introduction.html

This was referenced Jul 27, 2015
@averagehat
Copy link
Contributor Author

Closing in favor of #155, as Luigi requires a running Tornado server and is more verbose. If we hit the limits of Make we can consider it among some other options.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant