Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DAT-17482] Integrating Bigquery into liquibase #5838

Open
wants to merge 503 commits into
base: master
Choose a base branch
from

Conversation

filipelautert
Copy link
Collaborator

Impact

  • Bug fix (non-breaking change which fixes expected existing functionality)
  • Enhancement/New feature (adds functionality without impacting existing logic)
  • Breaking change (fix or feature that would cause existing functionality to change)

Description

Things to be aware of

Things to worry about

Additional Context

nvoxland and others added 30 commits April 24, 2023 16:28
Bumps [jacoco-maven-plugin](https://github.com/jacoco/jacoco) from 0.8.9 to 0.8.10.
- [Release notes](https://github.com/jacoco/jacoco/releases)
- [Commits](jacoco/jacoco@v0.8.9...v0.8.10)

---
updated-dependencies:
- dependency-name: org.jacoco:jacoco-maven-plugin
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Bumps [google-cloud-bigquerystorage](https://github.com/googleapis/java-bigquerystorage) from 2.34.2 to 2.36.1.
- [Release notes](https://github.com/googleapis/java-bigquerystorage/releases)
- [Changelog](https://github.com/googleapis/java-bigquerystorage/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-bigquerystorage@v2.34.2...v2.36.1)

---
updated-dependencies:
- dependency-name: com.google.cloud:google-cloud-bigquerystorage
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Bumps [google-cloud-bigquery](https://github.com/googleapis/java-bigquery) from 2.24.4 to 2.25.0.
- [Release notes](https://github.com/googleapis/java-bigquery/releases)
- [Changelog](https://github.com/googleapis/java-bigquery/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-bigquery@v2.24.4...v2.25.0)

---
updated-dependencies:
- dependency-name: com.google.cloud:google-cloud-bigquery
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Bumps [libraries-bom](https://github.com/googleapis/java-cloud-bom) from 26.12.0 to 26.14.0.
- [Release notes](https://github.com/googleapis/java-cloud-bom/releases)
- [Changelog](https://github.com/googleapis/java-cloud-bom/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-cloud-bom@v26.12.0...v26.14.0)

---
updated-dependencies:
- dependency-name: com.google.cloud:libraries-bom
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…oud-libraries-bom-26.14.0

Bump libraries-bom from 26.12.0 to 26.14.0
…oud-google-cloud-bigquery-2.25.0

Bump google-cloud-bigquery from 2.24.4 to 2.25.0
…oud-google-cloud-bigquerystorage-2.36.1

Bump google-cloud-bigquerystorage from 2.34.2 to 2.36.1
…coco-maven-plugin-0.8.10

Bump jacoco-maven-plugin from 0.8.9 to 0.8.10
…picocli-4.7.3

Bump picocli from 4.7.2 to 4.7.3
…sion-4.21.1

Bump liquibase.version from 4.21.0 to 4.21.1
Bumps [maven-surefire-plugin](https://github.com/apache/maven-surefire) from 3.0.0 to 3.1.0.
- [Release notes](https://github.com/apache/maven-surefire/releases)
- [Commits](apache/maven-surefire@surefire-3.0.0...surefire-3.1.0)

---
updated-dependencies:
- dependency-name: org.apache.maven.plugins:maven-surefire-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…ven.plugins-maven-surefire-plugin-3.1.0

Bump maven-surefire-plugin from 3.0.0 to 3.1.0
Bumps `liquibase.version` from 4.21.1 to 4.22.0.

Updates `liquibase-core` from 4.21.1 to 4.22.0
- [Release notes](https://github.com/liquibase/liquibase/releases)
- [Changelog](https://github.com/liquibase/liquibase/blob/master/changelog.txt)
- [Commits](v4.21.1...v4.22.0)

Updates `liquibase-maven-plugin` from 4.21.1 to 4.22.0
- [Release notes](https://github.com/liquibase/liquibase/releases)
- [Changelog](https://github.com/liquibase/liquibase/blob/master/changelog.txt)
- [Commits](v4.21.1...v4.22.0)

---
updated-dependencies:
- dependency-name: org.liquibase:liquibase-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.liquibase:liquibase-maven-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…sion-4.22.0

Bump liquibase.version from 4.21.1 to 4.22.0
Bumps [picocli](https://github.com/remkop/picocli) from 4.7.3 to 4.7.4.
- [Release notes](https://github.com/remkop/picocli/releases)
- [Changelog](https://github.com/remkop/picocli/blob/main/RELEASE-NOTES.md)
- [Commits](remkop/picocli@v4.7.3...v4.7.4)

---
updated-dependencies:
- dependency-name: info.picocli:picocli
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
…picocli-4.7.4

Bump picocli from 4.7.3 to 4.7.4
Bumps [google-cloud-bigquery](https://github.com/googleapis/java-bigquery) from 2.25.0 to 2.28.0.
- [Release notes](https://github.com/googleapis/java-bigquery/releases)
- [Changelog](https://github.com/googleapis/java-bigquery/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-bigquery@v2.25.0...v2.28.0)

---
updated-dependencies:
- dependency-name: com.google.cloud:google-cloud-bigquery
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…oud-google-cloud-bigquery-2.28.0

Bump google-cloud-bigquery from 2.25.0 to 2.28.0
Bumps [google-http-client](https://github.com/googleapis/google-http-java-client) from 1.43.1 to 1.43.3.
- [Release notes](https://github.com/googleapis/google-http-java-client/releases)
- [Changelog](https://github.com/googleapis/google-http-java-client/blob/main/CHANGELOG.md)
- [Commits](googleapis/google-http-java-client@v1.43.1...v1.43.3)

---
updated-dependencies:
- dependency-name: com.google.http-client:google-http-client
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
…tp-client-google-http-client-1.43.3

Bump google-http-client from 1.43.1 to 1.43.3
Bumps [google-cloud-bigquerystorage](https://github.com/googleapis/java-bigquerystorage) from 2.36.1 to 2.39.0.
- [Release notes](https://github.com/googleapis/java-bigquerystorage/releases)
- [Changelog](https://github.com/googleapis/java-bigquerystorage/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-bigquerystorage@v2.36.1...v2.39.0)

---
updated-dependencies:
- dependency-name: com.google.cloud:google-cloud-bigquerystorage
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…oud-google-cloud-bigquerystorage-2.39.0

Bump google-cloud-bigquerystorage from 2.36.1 to 2.39.0
Bumps [google-cloud-bigquery](https://github.com/googleapis/java-bigquery) from 2.28.0 to 2.29.0.
- [Release notes](https://github.com/googleapis/java-bigquery/releases)
- [Changelog](https://github.com/googleapis/java-bigquery/blob/main/CHANGELOG.md)
- [Commits](googleapis/java-bigquery@v2.28.0...v2.29.0)

---
updated-dependencies:
- dependency-name: com.google.cloud:google-cloud-bigquery
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
…oud-google-cloud-bigquery-2.29.0

Bump google-cloud-bigquery from 2.28.0 to 2.29.0
Bumps `liquibase.version` from 4.22.0 to 4.23.0.

Updates `liquibase-core` from 4.22.0 to 4.23.0
- [Release notes](https://github.com/liquibase/liquibase/releases)
- [Changelog](https://github.com/liquibase/liquibase/blob/master/changelog.txt)
- [Commits](v4.22.0...v4.23.0)

Updates `liquibase-maven-plugin` from 4.22.0 to 4.23.0
- [Release notes](https://github.com/liquibase/liquibase/releases)
- [Changelog](https://github.com/liquibase/liquibase/blob/master/changelog.txt)
- [Commits](v4.22.0...v4.23.0)

---
updated-dependencies:
- dependency-name: org.liquibase:liquibase-core
  dependency-type: direct:production
  update-type: version-update:semver-minor
- dependency-name: org.liquibase:liquibase-maven-plugin
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Copy link
Contributor

@KushnirykOleh KushnirykOleh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I can approve this PR from a code standpoint. But regarding licensing standpoint and what's going on in the lib folder need someone else to take a look.

Copy link

github-actions bot commented May 1, 2024

FOSSA Snippets Detection 🤖success

Snippets Detection Output

Running FOSSA snippets
 INFO main{target=/home/runner/work/liquibase/liquibase/}: Analyzing local snippet matches
 INFO main{target=/home/runner/work/liquibase/liquibase/}: Finished matching 0 snippets out of 4510 files to 0 matches


Pusher: @filipelautert, Action: pull_request, Working Directory: /home/runner/work/liquibase/liquibase, Workflow: FOSSA License Compliance and Security Check

Copy link

github-actions bot commented May 1, 2024

FOSSA Test 🧪success

Test Output


Using project name: `https://github.com/liquibase/liquibase`
Using revision: `35769a04cf0bb37b1a22d2a61e47325d63274c6b`

[ Checking build completion for 35769a04cf0bb37b1a22d2a61e47325d63274c6b... ]
[ Waiting for build completion (revision 35769a04cf0bb37b1a22d2a61e47325d63274c6b)... last status: StatusCreated ]
[ Waiting for build completion (revision 35769a04cf0bb37b1a22d2a61e47325d63274c6b)... last status: StatusRunning ]
[ Waiting for build completion (revision 35769a04cf0bb37b1a22d2a61e47325d63274c6b)... last status: StatusRunning ]
[ Waiting for build completion (revision 35769a04cf0bb37b1a22d2a61e47325d63274c6b)... last status: StatusRunning ]
[ Waiting for build completion (revision 35769a04cf0bb37b1a22d2a61e47325d63274c6b)... last status: StatusRunning ]
[ Waiting for issue scan completion... ]


[ERROR] 

  ========================================================================
  Tested Following Project:
  ========================================================================


  Project Title: https://github.com/liquibase/liquibase
  Project Revision: 35769a04cf0bb37b1a22d2a61e47325d63274c6b
  Project Visibility: private
  Project Targets:
  - maven: [pom.xml]


  COMPLIANCE ISSUES (Total 26)

  ========================================================================
  Flagged by Policy (Total 26)
  ========================================================================
  ⚑ LGPL-3.0-only license detected in com.github.javaparser:javaparser-core@3.25.9
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/5053794

  ⚑ LGPL-3.0-or-later license detected in com.github.javaparser:javaparser-core@3.25.9
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/5053793

  ⚑ LGPL-3.0-or-later license detected in com.h2database:h2@2.2.224
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4850918

  ⚑ GPL-2.0-with-classpath-exception license detected in com.sun.istack:istack-commons-runtime@4.1.2
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4934920

  ⚑ GPL-2.0-with-classpath-exception license detected in jakarta.activation:jakarta.activation-api@2.1.3
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/5173516

  ⚑ GPL-2.0-with-classpath-exception license detected in jakarta.annotation:jakarta.annotation-api@2.1.0
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4934922

  ⚑ GPL-2.0-with-classpath-exception license detected in jakarta.el:jakarta.el-api@5.0.0
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4934924

  ⚑ GPL-2.0-with-classpath-exception license detected in jakarta.enterprise:jakarta.enterprise.cdi-api@4.0.1
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4934916

  ⚑ GPL-2.0-with-classpath-exception license detected in jakarta.enterprise:jakarta.enterprise.lang-model@4.0.1
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4934919

  ⚑ GPL-2.0-with-classpath-exception license detected in jakarta.interceptor:jakarta.interceptor-api@2.1.0
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4934928

  ⚑ GPL-2.0-with-classpath-exception license detected in jakarta.servlet:jakarta.servlet-api@5.0.0
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4934931

  ⚑ GPL-2.0-with-classpath-exception license detected in jakarta.xml.bind:jakarta.xml.bind-api@4.0.2
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/5173517

  ⚑ GPL-2.0-only license detected in javax.activation:javax.activation-api@1.2.0
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4414991

  ⚑ GPL-2.0-with-classpath-exception license detected in javax.activation:javax.activation-api@1.2.0
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4414990

  ⚑ GPL-2.0-with-classpath-exception license detected in javax.servlet:javax.servlet-api@3.1.0
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4934935

  ⚑ GPL-2.0-only license detected in javax.xml.bind:jaxb-api@2.3.1
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4414993

  ⚑ GPL-2.0-with-classpath-exception license detected in javax.xml.bind:jaxb-api@2.3.1
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4414992

  ⚑ LGPL-2.1-or-later license detected in net.java.dev.jna:jna@5.13.0
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/4934934

  ⚑ GPL-2.0-with-classpath-exception license detected in org.eclipse.angus:angus-activation@2.0.2
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/5173515

  ⚑ LGPL-2.1-only license detected in org.firebirdsql.jdbc:jaybird@5.0.4.java8
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/5173521

  ⚑ LGPL-3.0-only license detected in org.firebirdsql.jdbc:jaybird@5.0.4.java8
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/5173520

  ⚑ GPL-2.0-with-classpath-exception license detected in org.glassfish.jaxb:jaxb-core@4.0.5
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/5173518

  ⚑ GPL-2.0-with-classpath-exception license detected in org.glassfish.jaxb:jaxb-runtime@4.0.5
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/5173519

  ⚑ GPL-2.0-with-classpath-exception license detected in org.glassfish.jaxb:txw2@4.0.5
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/5173522

  ⚑ GPL-2.0-or-later license detected in org.yaml:snakeyaml@2.2
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/3779967

  ⚑ LGPL-2.1-or-later license detected in org.yaml:snakeyaml@2.2
  More information: https://app.fossa.com/projects/custom%2B40163%2Fgithub.com%2Fliquibase%2Fliquibase/refs/branch/master/35769a04cf0bb37b1a22d2a61e47325d63274c6b/issues/licensing/3779966


[ERROR] An issue occurred

  *** Relevant Errors ***

      �[0;91mError: �[0mThe scan has revealed issues. Number of issues found: 26




Pusher: @filipelautert, Action: pull_request, Working Directory: /home/runner/work/liquibase/liquibase, Workflow: FOSSA License Compliance and Security Check

@filipelautert filipelautert changed the title [DAT-17482] "Integrating Bigquery into liquibase [DAT-17482] Integrating Bigquery into liquibase May 2, 2024
Scope.getCurrentScope().getLog(this.getClass()).info("Sequences are not supported by BigQuery");
return null;
}

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hi @filipelautert
When I added Function support to BigQuerry I got the next error if the getSelectSequenceStatement and replaces methods were removed
image

At the same time, the SQL from the bigquery repository was incorrect, so I had to fix it
https://github.com/liquibase/liquibase-bigquery/blob/main/src/main/java/liquibase/ext/bigquery/snapshot/jvm/BigQuerySequenceSnapshotGenerator.java#L52

            "SELECT NULL AS SEQUENCE_NAME, NULL AS START_VALUE, NULL AS MIN_VALUE, NULL AS MAX_VALUE, " +
                    "NULL AS INCREMENT_BY, " +
                    "NULL AS WILL_CYCLE " +
                    "FROM " +
                    jdbcSchemaName + "." + database.getSystemSchema().toUpperCase() + ".COLUMNS WHERE 1=0");

Should the methods be removed?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet