Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Skypilot with Kubernetes #3033

Merged
merged 23 commits into from
Sep 25, 2024
Merged

Skypilot with Kubernetes #3033

merged 23 commits into from
Sep 25, 2024

Commits on Sep 21, 2024

  1. Add Skypilot Kubernetes integration for remote orchestration 

    This commit adds the Skypilot Kubernetes integration to enable remote orchestration of ZenML pipelines on VMs. The integration includes the necessary initialization, configuration, and flavor classes. It also adds the Skypilot Kubernetes orchestrator and its settings. This integration provides an alternative to the local orchestrator for running pipelines on Kubernetes.
    @safoinme
    safoinme committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    c5aead6 View commit details
    Browse the repository at this point in the history

  2. Add Skypilot Kubernetes integration for remote orchestration

    @safoinme
    safoinme committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    342fa34 View commit details
    Browse the repository at this point in the history

  3. Refactor SkypilotKubernetesOrchestrator prepare_environment_variable … 

    …method
    @safoinme
    safoinme committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    7590584 View commit details
    Browse the repository at this point in the history

  4. Refactor SkypilotKubernetesOrchestrator prepare_environment_variable … 

    …method
    @safoinme
    safoinme committed Sep 21, 2024
    Configuration menu
    Copy the full SHA
    03951d8 View commit details
    Browse the repository at this point in the history

Commits on Sep 22, 2024

  1. Refactor SkypilotKubernetesOrchestrator prepare_environment_variable … 

    …method
    @safoinme
    safoinme committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    89718f0 View commit details
    Browse the repository at this point in the history

  2. Refactor SkypilotBaseOrchestrator setup_credentials method

    @safoinme
    safoinme committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    775253f View commit details
    Browse the repository at this point in the history

  3. Refactor SkypilotBaseOrchestrator setup_credentials method and Skypil… 

    …otKubernetesOrchestrator prepare_environment_variable method
    @safoinme
    safoinme committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    4b42940 View commit details
    Browse the repository at this point in the history

  4. Refactor SkypilotBaseOrchestrator setup_credentials method and Skypil… 

    …otKubernetesOrchestrator prepare_environment_variable method
    @safoinme
    safoinme committed Sep 22, 2024
    Configuration menu
    Copy the full SHA
    305322e View commit details
    Browse the repository at this point in the history

Commits on Sep 23, 2024

  1. Update src/zenml/integrations/skypilot/orchestrators/skypilot_base_vm… 

    …_orchestrator.py

Co-authored-by: Stefan Nica <[email protected]>
    @safoinme @stefannica
    safoinme and stefannica authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    edae0e8 View commit details
    Browse the repository at this point in the history

  2. Merge branch 'develop' into feature/skypilot-kubernetes

    @safoinme
    safoinme authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    2c68fa6 View commit details
    Browse the repository at this point in the history

  3. Merge branch 'feature/skypilot-kubernetes' of https://github.com/zenm… 

    …l-io/zenml into feature/skypilot-kubernetes
    @safoinme
    safoinme committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    38922b2 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'develop' into feature/skypilot-kubernetes

    @safoinme
    safoinme authored Sep 23, 2024
    Configuration menu
    Copy the full SHA
    364f8ac View commit details
    Browse the repository at this point in the history

  5. Refactor SkypilotKubernetesOrchestrator to handle missing service con… 

    …nector
    @safoinme
    safoinme committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    85e7f63 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'feature/skypilot-kubernetes' of https://github.com/zenm… 

    …l-io/zenml into feature/skypilot-kubernetes
    @safoinme
    safoinme committed Sep 23, 2024
    Configuration menu
    Copy the full SHA
    2c421b0 View commit details
    Browse the repository at this point in the history

Commits on Sep 24, 2024

  1. Refactor SkypilotBaseOrchestrator to use the correct virtual environm… 

    …ent path for Kubernetes
    @safoinme
    safoinme committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    f4639f6 View commit details
    Browse the repository at this point in the history

  2. specll check

    @safoinme
    safoinme committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    46194cc View commit details
    Browse the repository at this point in the history

  3. Merge branch 'develop' into feature/skypilot-kubernetes

    @safoinme
    safoinme authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    abf58c4 View commit details
    Browse the repository at this point in the history

  4. fix run command

    @safoinme
    safoinme committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    b3a4520 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'feature/skypilot-kubernetes' of https://github.com/zenm… 

    …l-io/zenml into feature/skypilot-kubernetes
    @safoinme
    safoinme committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    1eef87a View commit details
    Browse the repository at this point in the history

  6. Refactor SkypilotKubernetesVMOrchestrator to remove unnecessary code

    @safoinme
    safoinme committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    615c083 View commit details
    Browse the repository at this point in the history

  7. Merge branch 'develop' into feature/skypilot-kubernetes

    @safoinme
    safoinme authored Sep 24, 2024
    Configuration menu
    Copy the full SHA
    5b48068 View commit details
    Browse the repository at this point in the history

  8. Refactor SkypilotKubernetesVMOrchestrator to remove unnecessary code

    @safoinme
    safoinme committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    98973a6 View commit details
    Browse the repository at this point in the history

  9. Merge branch 'feature/skypilot-kubernetes' of https://github.com/zenm… 

    …l-io/zenml into feature/skypilot-kubernetes
    @safoinme
    safoinme committed Sep 24, 2024
    Configuration menu
    Copy the full SHA
    126eefb View commit details
    Browse the repository at this point in the history