Workflows Executor Plugin and State Management

[greenpau]

I am working on a Workflows Executor Plugin and trying figure out how to keep state for long-running task.

When I start the task, the plugin should get execution id from backend system and use that id in all subsequent invocations.

The plugin returns Pending with retry in 1 minute.

The expectation is that the subsequent call to the plugin will be passed with previously received execution id.

Reviewed a number of plugins, but did not see any code where the plugin returns some kind of id, which in turn gets passed after subsequent invocation until completion (success/failure).

[greenpau]

What is unclear whether a task gets its own dedicated “plugin” container. If that is true, and the container is not shared between tasks (workflows) then the state can be maintained globally for the instance of a plugin.

[agilgur5]

Generally, each task gets its own Pod and an executor plugin is a sidecar container of the main container.

Every Workflow and task node has identifiers, so if you need a unique identifier, I would use the existing ones in the spec.