Skip to content

Commit

Permalink
Add blog post links in documentation (flyteorg#908)
Browse files Browse the repository at this point in the history
* Add blog post links in documentation

Signed-off-by: 3t8 <[email protected]>

* update configuring_links (flyteorg#905)

* update configuring_links

Fixes flyteorg/flyte#2820
Signed-off-by: SmritiSatyanV [email protected]

* update configuring links

Changes based on review
Signed-off-by: SmritiSatyanV [email protected]
Signed-off-by: 3t8 <[email protected]>

* Update map_task.py

Signed-off-by: 3t8 <[email protected]>

* Update cookbook/integrations/external_services/airflow/README.rst

Co-authored-by: Samhita Alla <[email protected]>
Signed-off-by: 3t8 <[email protected]>

* Update README.rst

Signed-off-by: 3t8 <[email protected]>

* Update dynamics.py

Signed-off-by: 3t8 <[email protected]>

* Delete configure_logging_links.py

Signed-off-by: 3t8 <[email protected]>

* Revert "Delete configure_logging_links.py"

This reverts commit 3fda83e.

Restore configure_logging_links

Signed-off-by: 3t8 <[email protected]>

Signed-off-by: 3t8 <[email protected]>
Co-authored-by: SmritiSatyanV <[email protected]>
Co-authored-by: Samhita Alla <[email protected]>
  • Loading branch information
3 people authored and ryankarlos committed Oct 17, 2022
1 parent 093a9b8 commit 8aa48c0
Show file tree
Hide file tree
Showing 8 changed files with 145 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -58,3 +58,21 @@ Takeaways
#. Source data is from SQL-like data sources
#. Procreated feature transforms
#. Serve features to production using Feast

.. panels::
:header: text-center
:column: col-lg-12 p-2

.. link-button:: https://blog.flyte.org/bring-ml-close-to-data-using-feast-and-flyte
:type: url
:text: Blog Post
:classes: btn-block stretched-link
^^^^^^^^^^^^
An article detailing Feast and Flyte integration.

.. toctree::
:maxdepth: -1
:caption: Contents
:hidden:

Blog Post <https://blog.flyte.org/bring-ml-close-to-data-using-feast-and-flyte>
18 changes: 18 additions & 0 deletions cookbook/case_studies/ml_training/spark_horovod/README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -80,3 +80,21 @@ Run workflows in this directory with the custom-built base image like so:
.. prompt:: bash $

pyflyte run --remote keras_spark_rossmann_estimator.py:horovod_spark_wf --image ghcr.io/flyteorg/flytecookbook:spark_horovod-latest

.. panels::
:header: text-center
:column: col-lg-12 p-2

.. link-button:: https://blog.flyte.org/data-parallel-distributed-training-with-horovod-and-flyte
:type: url
:text: Blog Post
:classes: btn-block stretched-link
^^^^^^^^^^^^
An article detailing data-parallel distributed training with Horovod and Flyte.

.. toctree::
:maxdepth: -1
:caption: Contents
:hidden:

Blog Post <https://blog.flyte.org/data-parallel-distributed-training-with-horovod-and-flyte>
19 changes: 19 additions & 0 deletions cookbook/core/control_flow/dynamics.py
Original file line number Diff line number Diff line change
Expand Up @@ -205,3 +205,22 @@ def wf(s1: str, s2: str) -> int:
#
# Dynamic tasks have overhead for large fan-out tasks because they store metadata for the entire workflow. In contrast, map tasks are efficient for these large fan-out tasks since they don’t store the metadata, as a consequence of which overhead is less apparent.
#

# %%
# .. panels::
# :header: text-center
# :column: col-lg-12 p-2
#
# .. link-button:: https://blog.flyte.org/dynamic-workflows-in-flyte
# :type: url
# :text: Blog Post
# :classes: btn-block stretched-link
# ^^^^^^^^^^^^
# An article on how to use Dynamic Workflows in Flyte.
#
# .. toctree::
# :maxdepth: -1
# :caption: Contents
# :hidden:
#
# Blog Post <https://blog.flyte.org/dynamic-workflows-in-flyte>
19 changes: 19 additions & 0 deletions cookbook/core/control_flow/map_task.py
Original file line number Diff line number Diff line change
Expand Up @@ -145,3 +145,22 @@ def multiple_workflow(list_q: List[float], p: float, s: float) -> List[float]:
if __name__ == "__main__":
result = multiple_workflow(list_q=[1.0, 2.0, 3.0, 4.0, 5.0], p=6.0, s=7.0)
print(f"{result}")

# %%
# .. panels::
# :header: text-center
# :column: col-lg-12 p-2
#
# .. link-button:: https://blog.flyte.org/map-tasks-in-flyte
# :type: url
# :text: Blog Post
# :classes: btn-block stretched-link
# ^^^^^^^^^^^^
# An article on how to use Map Taks in Flyte.
#
# .. toctree::
# :maxdepth: -1
# :caption: Contents
# :hidden:
#
# Blog Post <https://blog.flyte.org/map-tasks-in-flyte>
18 changes: 18 additions & 0 deletions cookbook/integrations/external_services/airflow/README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -16,3 +16,21 @@ Installation
pip install airflow-provider-flyte
All the configuration options for the provider are available in the provider repo's `README <https://github.com/flyteorg/airflow-provider-flyte#readme>`__.

.. panels::
:header: text-center
:column: col-lg-12 p-2

.. link-button:: https://blog.flyte.org/scale-airflow-for-machine-learning-tasks-with-the-flyte-airflow-provider
:type: url
:text: Blog Post
:classes: btn-block stretched-link
^^^^^^^^^^^^
An article on how to use the Flyte Airflow provider to trigger Flyte tasks from within Airflow.

.. toctree::
:maxdepth: -1
:caption: Contents
:hidden:

Blog Post <https://blog.flyte.org/scale-airflow-for-machine-learning-tasks-with-the-flyte-airflow-provider>
18 changes: 18 additions & 0 deletions cookbook/integrations/flytekit_plugins/dolt/README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -27,3 +27,21 @@ These demos assume a ``foo`` database has been created locally:
mkdir foo
cd foo
dolt init
.. panels::
:header: text-center
:column: col-lg-12 p-2

.. link-button:: https://blog.flyte.org/upleveling-flyte-data-lineage-using-dolt
:type: url
:text: Blog Post
:classes: btn-block stretched-link
^^^^^^^^^^^^
An article detailing Dolt and Flyte integration.

.. toctree::
:maxdepth: -1
:caption: Contents
:hidden:

Blog Post <https://blog.flyte.org/upleveling-flyte-data-lineage-using-dolt>
Original file line number Diff line number Diff line change
Expand Up @@ -104,3 +104,21 @@ To use the Great Expectations Flyte plugin, run the following command:

.. note::
Make sure to run workflows from the "flytekit_plugins" directory.

.. panels::
:header: text-center
:column: col-lg-12 p-2

.. link-button:: https://blog.flyte.org/data-quality-enforcement-using-great-expectations-and-flyte
:type: url
:text: Blog Post
:classes: btn-block stretched-link
^^^^^^^^^^^^
An article detailing Great Expectations and Flyte integration.

.. toctree::
:maxdepth: -1
:caption: Contents
:hidden:

Blog Post <https://blog.flyte.org/data-quality-enforcement-using-great-expectations-and-flyte>
17 changes: 17 additions & 0 deletions cookbook/integrations/kubernetes/ray_example/README.rst
Original file line number Diff line number Diff line change
Expand Up @@ -51,3 +51,20 @@ Create a Ray Cluster Managed by Flyte and Run a Ray Job on This Cluster
futures = [f.remote(i) for i in range(5)]
return ray.get(futures)

.. panels::
:header: text-center
:column: col-lg-12 p-2

.. link-button:: https://blog.flyte.org/ray-and-flyte
:type: url
:text: Blog Post
:classes: btn-block stretched-link
^^^^^^^^^^^^
An article detailing Ray and Flyte integration.

.. toctree::
:maxdepth: -1
:caption: Contents
:hidden:

Blog Post <https://blog.flyte.org/ray-and-flyte>

0 comments on commit 8aa48c0

Please sign in to comment.