Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support multiple dbt project roots in a single repo #193

Open
ammarchalifah-bolt opened this issue Mar 6, 2024 · 2 comments
Open

Support multiple dbt project roots in a single repo #193

ammarchalifah-bolt opened this issue Mar 6, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@ammarchalifah-bolt
Copy link

We have a multi-project structure within a single dbt repo. Is it possible to set up multiple project root directories in a single .dbt-checkpoint.yml file?

@ammarchalifah-bolt ammarchalifah-bolt added the enhancement New feature or request label Mar 6, 2024
@pgoslatara
Copy link
Contributor

@ammarchalifah-bolt Do you mean a single .pre-commit-config.yaml file?

@louistransfer
Copy link

Hello,
I also have the exact same use case : I have a centralized "dbt" folder, each of them containing a store, e.g :

  • dbt/store_a/target/manifest.json
  • dbt/store_b/target/manifest.json
    etc

It would be ideal to be able to either have a configuration supporting multiple folders or to at least give a glob-like path to find the manifest.json, from a single .pre-commit-config.yaml. It could probably be added in the .dbt-checkpoint.yaml,
something like this :

Solution 1

version: 1
dbt-project-dirs: 
   store_a:	
      - dbt/store_a/target
   store_b:	
      - dbt/store_b/target

or

Solution 2

dbt-projects-glob: dbt/*/target

I know that this sound quite exotic, yet I believe that this dbt architecture could be more and more used as more people are advocating for multi-repo dbts (examples :

Now I guess that the change could be quite tricky, yet it would help tremendously when an engineer modifies multiple identical marts for distinct companies to ensure that the commits are ok.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants