You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Originally posted by cs-gennadiy April 21, 2024
Please advise or correct me in following Use Case:
With kfp V1:
componentA: submits spark application by container with kubectl apply -f spark_app_manifest.yml to spark operator
componentB (task inner to componentC): gets application state by kubectl get SparkApplication myApp ...
componentC (with "@graph_component" decorator): creates and runs task from componentB. Checks application state - if it isn't equal to "COMPLETED", then runs itself recursively.
With kfp V2:
the "@graph_component" decorator doesn't exist, so there is no way to run a task recursively. A workaround would be to implement "get and check state" loop, like "while" loop, inside of the same component function or command (E.g. using of "dsl.If" wouldn't be possible then).
Is my assumption for V2 correct?
The text was updated successfully, but these errors were encountered:
/area sdk
/kind feature
Discussed in #10717
Originally posted by cs-gennadiy April 21, 2024
Please advise or correct me in following Use Case:
With kfp V1:
kubectl apply -f spark_app_manifest.yml
to spark operatorkubectl get SparkApplication myApp ...
With kfp V2:
the "@graph_component" decorator doesn't exist, so there is no way to run a task recursively. A workaround would be to implement "get and check state" loop, like "while" loop, inside of the same component function or command (E.g. using of "dsl.If" wouldn't be possible then).
Is my assumption for V2 correct?
The text was updated successfully, but these errors were encountered: