Skip to content
This repository has been archived by the owner on Dec 5, 2019. It is now read-only.

Add support for scheduled Zeppelin notebooks #571

Open
3 tasks
maurodoglio opened this issue Jun 21, 2017 · 3 comments
Open
3 tasks

Add support for scheduled Zeppelin notebooks #571

maurodoglio opened this issue Jun 21, 2017 · 3 comments
Assignees
Milestone

Comments

@maurodoglio
Copy link
Contributor

To fully embrace Zeppelin as a first class citizen in our data analysis tools, we need to provide ATMO users with the ability to schedule Zeppelin notebooks. Here is a draft list of use cases:

  • As a user, I want to be able to create a new scheduled job provided a Zeppelin notebook.
  • As a user, when I schedule a Zeppelin notebook, I expect the notebook to be rendered in the job detail view.
  • As a user, I expect to see the list of results, logs and runs of a scheduled Zeppelin notebook in the job detail view.

Here is a draft list of tasks required to make it work:

  • Modify batch.sh to make it use zeppelin executor when dealing with a Zeppelin notebook.
  • Modify the job detail view to render a Zeppelin notebook either using the zeppelin markdown converter or via a new html/js converter.
  • Modify the job creation form to also accept Zeppelin notebooks.

Feel free to change this list as needed. Once this list is stable we can open one issue per task.

@maurodoglio
Copy link
Contributor Author

@comloo is going to give us a hand to implement this feature.

@comloo comloo self-assigned this Jun 22, 2017
@rafrombrc rafrombrc added this to the m4 milestone Jun 22, 2017
@rafrombrc rafrombrc assigned robhudson and unassigned comloo Aug 30, 2017
@rafrombrc
Copy link
Member

Wendy's code has been merged, assigning to Rob Hudson who will do some final clean-up before closing.

@robhudson
Copy link
Member

Here's what I consider left before calling this done:

  • Add some extra unit testing around the Zeppelin job provisioners
  • Minor UI cleanup viewing completed notebooks
  • Push out the EMR bootstrap bucket to production

@rafrombrc rafrombrc modified the milestones: m4, m5 Sep 20, 2017
@jezdez jezdez added ready and removed in progress labels Jan 17, 2019
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

5 participants