Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

workflow-ify lab data model maintenance scripts #496

Open
dpark01 opened this issue Oct 26, 2023 · 0 comments
Open

workflow-ify lab data model maintenance scripts #496

dpark01 opened this issue Oct 26, 2023 · 0 comments
Assignees
Labels
enhancement New feature or request

Comments

@dpark01
Copy link
Member

dpark01 commented Oct 26, 2023

Create new workflow to manage lab data model post demux. This entails a few key to-dos:

  1. Improve naming of current existing data model (sample, sample_set, sample_set_set) now that we know how to create relational links between differently named Terra tables
  2. Convert all notebook code to WDL in order to greatly improve (and make consistent) the user experience
  3. Have separate WDL tasks for introspection and data model maintenance.
  4. Implement initially as a standalone workflow -- maybe some day include at the end of demux_deplete but not initially.
  5. Current scope: just support Terra-on-GCP (and be able to nop properly if introspection shows we're not in that environment). Eventually support Terra-on-Azure/WDS as well.
@dpark01 dpark01 added the enhancement New feature or request label Oct 26, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants