You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently the map_task construct only works for regular PythonFunctionTasks. Pod tasks are close enough to regular function tasks however that they should be supported as well.
Goal
To be able to map over Pod Tasks and have the correct PodSpec applied to the run-time pod.
Alternatives
None
Additional Context
Currently the container object generated by the map task looks something like this, when mapping over a basic PythonFunctionTask.
This ends up actually kinda working, since Pod tasks are closely related to regular function tasks, but all the Pod dependencies are missing.
The custom field in the map task TaskTemplate today is an ArrayJob. We'll have to figure out how to add the PodSpec in addition to the ArrayJob, and how to invoke the Pod plugin instead of just the container plugin.
Map support for Pod Tasks
Motivation
Currently the map_task construct only works for regular
PythonFunctionTask
s. Pod tasks are close enough to regular function tasks however that they should be supported as well.Goal
To be able to map over Pod Tasks and have the correct
PodSpec
applied to the run-time pod.Alternatives
None
Additional Context
Currently the container object generated by the map task looks something like this, when mapping over a basic
PythonFunctionTask
.This ends up actually kinda working, since Pod tasks are closely related to regular function tasks, but all the Pod dependencies are missing.
The
custom
field in the map task TaskTemplate today is anArrayJob
. We'll have to figure out how to add thePodSpec
in addition to theArrayJob
, and how to invoke the Pod plugin instead of just the container plugin.This is related to #1050
The text was updated successfully, but these errors were encountered: