Skip to content

ClouGence/cloudcanal-data-process

Repository files navigation

Overview

Custom Code allows users to write Java code with data processing logic , upload Java jar packages to CloudCanal, and CloudCanal automatically call these codes during Full Data and Incremental to achieve various data transformation processing purposes.

Project Description

  • wide-table
    • The fact table and dimension tables join processing code.
  • data-transform
    • General data transformation code, e.g., doing operation changes, adding additional fields, filter data,and so on.
  • data-gather
    • Aggregate sharding data code.e.g.,eliminate constraint conflicts, adding additional fields and so on.
  • data-compare
    • Verification and correction with business logic.
  • business-alert
    • Provides corresponding alarms based on stream data.

Steps

References

README.md

About

CloudCanal real-time sync custom Java process SDK

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages