Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add ability to submit ingestion job using Flink #62

Merged
merged 9 commits into from
Jan 18, 2019
Merged

Add ability to submit ingestion job using Flink #62

merged 9 commits into from
Jan 18, 2019

Commits on Jan 11, 2019

  1. Restructure Job Management components

    Pradithya Aria committed Jan 11, 2019
    Configuration menu
    Copy the full SHA
    7f0b231 View commit details
    Browse the repository at this point in the history

  2. Change JobMonitor.getJobStatus to accept JobInfo

    Pradithya Aria committed Jan 11, 2019
    Configuration menu
    Copy the full SHA
    852e668 View commit details
    Browse the repository at this point in the history

  3. Fix compilation error on test

    Pradithya Aria committed Jan 11, 2019
    Configuration menu
    Copy the full SHA
    72d8c5b View commit details
    Browse the repository at this point in the history

  4. Implement Flink job submission and status monitoring

    Pradithya Aria committed Jan 11, 2019
    Configuration menu
    Copy the full SHA
    e2ed557 View commit details
    Browse the repository at this point in the history

  5. Add configuration for Flink

    Pradithya Aria committed Jan 11, 2019
    Configuration menu
    Copy the full SHA
    9c0e0a4 View commit details
    Browse the repository at this point in the history

  6. Skip metrics if it's not for particular runner

    Pradithya Aria committed Jan 11, 2019
    Configuration menu
    Copy the full SHA
    423a376 View commit details
    Browse the repository at this point in the history

  7. Fix logging for DataflowJobMonitor

    Pradithya Aria committed Jan 11, 2019
    Configuration menu
    Copy the full SHA
    201dcbb View commit details
    Browse the repository at this point in the history

Commits on Jan 12, 2019

  1. Add license

    Pradithya Aria committed Jan 12, 2019
    Configuration menu
    Copy the full SHA
    28d2aec View commit details
    Browse the repository at this point in the history

  2. Set job status in DirectRunner to COMPLETED after submission since it… 

    … runs in blocking fashion
    Pradithya Aria committed Jan 12, 2019
    Configuration menu
    Copy the full SHA
    418ee6b View commit details
    Browse the repository at this point in the history