Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reorganize sqlite3 user guide example #300

Merged
merged 11 commits into from
Jul 20, 2021
Merged
Show file tree
Hide file tree
Changes from 2 commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 2 additions & 4 deletions cookbook/docs/conf.py
Original file line number Diff line number Diff line change
Expand Up @@ -238,9 +238,8 @@ def __call__(self, filename):
"../deployment/cluster",
# "../deployment/guides", # TODO: add content to this section
# "../control_plane", # TODO: add content to this section
# "../integrations/flytekit_plugins/sqllite3", # TODO: add content to this section
"../integrations/flytekit_plugins/sql",
"../integrations/flytekit_plugins/papermilltasks",
# "../integrations/flytekit_plugins/sqlalchemy", # TODO: add content to this section
"../integrations/flytekit_plugins/pandera",
"../integrations/flytekit_plugins/dolt",
"../integrations/kubernetes/pod",
Expand All @@ -267,9 +266,8 @@ def __call__(self, filename):
"auto/deployment/cluster",
# "auto/deployment/guides", # TODO: add content to this section
# "auto/control_plane", # TODO: add content to this section
# "auto/integrations/flytekit_plugins/sqllite3", # TODO: add content to this section
"auto/integrations/flytekit_plugins/sql",
"auto/integrations/flytekit_plugins/papermilltasks",
# "auto/integrations/flytekit_plugins/sqlalchemy", # TODO: add content to this section
"auto/integrations/flytekit_plugins/pandera",
"auto/integrations/flytekit_plugins/dolt",
"auto/integrations/kubernetes/pod",
Expand Down
21 changes: 18 additions & 3 deletions cookbook/docs/flytekit_plugins.rst
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,15 @@ You can find the plugins maintained by the core flyte team `here <https://github
.. panels::
:header: text-center

.. link-button:: auto/integrations/flytekit_plugins/sql/index
:type: ref
:text: SQL
:classes: btn-block stretched-link
^^^^^^^^^^^^
Execute SQL queries as tasks.

---

.. link-button:: auto/integrations/flytekit_plugins/papermilltasks/index
:type: ref
:text: Papermill
Expand All @@ -34,16 +43,22 @@ You can find the plugins maintained by the core flyte team `here <https://github
^^^^^^^^^^^^
Validate pandas dataframes with ``pandera``.

---

.. link-button:: auto/integrations/flytekit_plugins/dolt/index
:type: ref
:text: Dolt
:classes: btn-block stretched-link
^^^^^^^^^^^^
Validate pandas dataframes with ``pandera``.
cosmicBboy marked this conversation as resolved.
Show resolved Hide resolved

.. TODO: add the following items to the TOC when the content is written.
.. - auto/integrations/flytekit_plugins/sqllite3/index
.. - auto/integrations/flytekit_plugins/sqlalchemy/index

.. toctree::
:maxdepth: -1
:caption: Contents
:hidden:

auto/integrations/flytekit_plugins/sql/index
auto/integrations/flytekit_plugins/papermilltasks/index
auto/integrations/flytekit_plugins/pandera/index
auto/integrations/flytekit_plugins/dolt/index
7 changes: 7 additions & 0 deletions cookbook/integrations/flytekit_plugins/sql/README.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
###
SQL
###

Flyte tasks are not always restricted to running user-supplied containers, nor even containers at all. Indeed, this is
one of the most important design decisions in Flyte. Non-container tasks can have arbitrary targets for execution -
example an API that executes SQL queries like SnowFlake, BigQuery etc, a synchronous WebAPI etc.
Original file line number Diff line number Diff line change
@@ -1,15 +1,8 @@
"""
.. _extend_sql_sqlite3:
.. _integrations_sql_sqlite3:

SQL Query Tasks
===============

SQLite3 Example
---------------

Flyte tasks are not always restricted to running user-supplied containers, nor even containers at all. Indeed, this is
one of the most important design decisions in Flyte. Non-container tasks can have arbitrary targets for execution -
example an API that executes SQL queries like SnowFlake, BigQuery etc, a synchronous WebAPI etc
Sqlite3
#######

The following example shows how you can write SQLite3 queries using the SQLite3Task, which is bundled as part of the
core flytekit. Since SQL Queries are portable across workflows and Flyte installations (as long as the data exists),
Expand Down

This file was deleted.

7 changes: 0 additions & 7 deletions cookbook/integrations/flytekit_plugins/sqllite3/README.rst

This file was deleted.