Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Support Cloud Bigtable Changestream #1569

Merged
merged 31 commits into from
Feb 10, 2023
Merged
Show file tree
Hide file tree
Changes from 27 commits
Commits
Show all changes
31 commits
Select commit Hold shift + click to select a range
6a4444f
feat: copy preview Change Streams API (#1309)
tonytanger Jul 14, 2022
c529f19
feat: Add ListChangeStreamPartitions callable (#1312)
tengzhonger Jul 20, 2022
39a7b58
feat: Create ReadChangeStreamQuery and ChangeStreamRecode::Heartbeat/…
tengzhonger Jul 26, 2022
53dd0f0
feat: Add ChangeStreamMutation which is a ChangeStreamRecord (#1324)
tengzhonger Aug 1, 2022
cb7b455
feat: Add ChangeStreamRecordAdapter and ChangeStreamStateMachine (#1334)
tengzhonger Aug 3, 2022
c612cf6
feat: Add readChangeStream callables (#1338)
tengzhonger Aug 8, 2022
9b30758
feat: Expose some package-private methods to be used by CDC beam code…
tengzhonger Aug 9, 2022
f1176ae
feat: Implement ReadChangeStreamResumptionStrategy (#1344)
tengzhonger Aug 10, 2022
bb5c0c0
feat: Add toByteString/fromByteString for ChangeStreamContinuationTok…
tengzhonger Aug 11, 2022
2a4e786
feat!: rename ListChangeStreamPartitions to GenerateInitialChangeStre…
tonytanger Aug 12, 2022
c3086d9
feat: Change CDC related APIs to return ByteStringRange instead of Ro…
tengzhonger Aug 15, 2022
351a151
feat: Return MutationType and bigtable.common.Status instead of raw p…
tengzhonger Aug 16, 2022
c631fa4
feat: Expose CDC data API settings in EnhancedBigtableStubSettings (#…
tengzhonger Sep 1, 2022
9e5994f
chore: pull in changes from main branch (#1379)
tengzhonger Sep 7, 2022
e0f5d84
chore: pull in changes from main branch (#1544)
jackdingilian Dec 13, 2022
053cba6
fix: resolve merge conflict in samples/native-image-sample/pom.xml (#…
jackdingilian Dec 13, 2022
7f0e9df
feat: Cdc rebase (#1566)
tengzhonger Jan 9, 2023
1ead0cd
Merge remote-tracking branch 'origin/main' into cdc
Jan 9, 2023
0a12471
Address comments
Jan 10, 2023
46193f9
fix test
Jan 10, 2023
613cfec
Merge branch 'main' into cdc
Jan 10, 2023
6108c4e
Correct the grpc & proto version
Jan 10, 2023
aff6021
Address comments
Jan 12, 2023
7ad8ac4
Address comments
Feb 7, 2023
9a278d0
Merge remote-tracking branch 'origin/main' into cdc
Feb 7, 2023
ab311fa
Update grpc version
Feb 7, 2023
6907ff3
Update comment
Feb 7, 2023
dc16628
Address comments
Feb 8, 2023
8f7c6dd
Merge remote-tracking branch 'origin/main' into cdc
Feb 10, 2023
00421c7
Delete accidentally added dependency-reduced-pom.xml file
Feb 10, 2023
3cb1dfc
Fix test
Feb 10, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
5 changes: 5 additions & 0 deletions google-cloud-bigtable/clirr-ignored-differences.xml
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,11 @@
<differenceType>8001</differenceType>
<className>com/google/cloud/bigtable/data/v2/stub/metrics/CompositeTracerFactory</className>
</difference>
<!-- InternalApi was renamed -->
<difference>
<differenceType>8001</differenceType>
<className>com/google/cloud/bigtable/data/v2/stub/readrows/ReadRowsConvertExceptionCallable</className>
</difference>
<!-- InternalApi that was removed -->
<difference>
<differenceType>8001</differenceType>
Expand Down
62 changes: 62 additions & 0 deletions google-cloud-bigtable/pom.xml
Original file line number Diff line number Diff line change
Expand Up @@ -36,6 +36,12 @@
<!-- This is used by bigtable-prod-batch-it profile to ensure that tests work on the batch endpoint.
Also, this property will be augmented by `internal-bigtable-prod-batch-it-prop-helper` profile -->
<bigtable.cfe-data-batch-endpoint>batch-bigtable.googleapis.com:443</bigtable.cfe-data-batch-endpoint>

<!-- These are needed to compile the protobuf used by Changestream merging acceptance test. We have enforcer rule
below to make sure that the versions here match the ones we pull in via the shared bom. -->
<grpc.version>1.52.1</grpc.version>
<protobuf.version>3.21.12</protobuf.version>
<protoc.version>${protobuf.version}</protoc.version>
</properties>

<dependencyManagement>
Expand Down Expand Up @@ -593,7 +599,63 @@
</profiles>

<build>
<extensions>
<extension>
<groupId>kr.motd.maven</groupId>
<artifactId>os-maven-plugin</artifactId>
<version>1.6.0</version>
</extension>
</extensions>
<plugins>
<plugin>
<groupId>org.apache.maven.plugins</groupId>
<artifactId>maven-enforcer-plugin</artifactId>
<version>3.1.0</version>
<executions>
<execution>
<id>enforce-declared-grpc-and-proto-version</id>
<goals>
<goal>enforce</goal>
</goals>
<configuration>
<rules>
<bannedDependencies>
<includes>
<dependency>io.grpc:*:[${grpc.version}]</dependency>
<dependency>com.google.protobuf:*:[${protobuf.version}]</dependency>
</includes>
<excludes>
<dependency>io.grpc:*</dependency>
<dependency>com.google.protobuf:*</dependency>
</excludes>
</bannedDependencies>
</rules>
</configuration>
</execution>
</executions>
</plugin>
<plugin>
<groupId>org.xolstice.maven.plugins</groupId>
<artifactId>protobuf-maven-plugin</artifactId>
<version>0.6.1</version>
<executions>
<execution>
<goals>
<goal>test-compile</goal>
<goal>test-compile-custom</goal>
</goals>
</execution>
</executions>
<configuration>
<protocArtifact>
com.google.protobuf:protoc:${protoc.version}:exe:${os.detected.classifier}
</protocArtifact>
<pluginId>grpc-java</pluginId>
<pluginArtifact>
io.grpc:protoc-gen-grpc-java:${grpc.version}:exe:${os.detected.classifier}
</pluginArtifact>
</configuration>
</plugin>
<plugin>
<groupId>org.codehaus.mojo</groupId>
<artifactId>build-helper-maven-plugin</artifactId>
Expand Down