Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create / publish guidance & examples for calling a source connector via a workflow #339

Open
jaydubb12 opened this issue Oct 25, 2022 · 0 comments

Comments

@jaydubb12
Copy link

Feature

Create / generate sample(s) that provide a contextual overview of the process / pattern a developer would utilize to call / reference a Source Connector within a TD Workflow.

Tasks

Create universal example

  1. Create an example and complimentary README.md to provide an overview of how a developer can leverage a Source configuration's uniqueID as a step within a TD workflow
+import_task:
      td_load>: {source_unique_id}

Create practical examples

  1. Create a revised example of the S3 v2 Import workflows to depict an example of how the solution can be utilized to realize the benefit / simplicity of the GUI configuration to setup a scheduled ingestion, and to then utilize a custom workflow to support failure / exception handling as well as downstream tasks such as data quality management or unification.

Deprecate legacy / outdated workflows

  1. Deprecate legacy example, that is annotated as an approach that is not recommended, and replace it with an example such as this, and potentially a secondary example that calls / references a workflow UUID, which is similar, but different than the Source uniqueID
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant