hazelcast-jet-contrib

This repository includes various community supported and incubating modules for Hazelcast Jet.

As a general guideline, the following types of modules are encouraged in this repository:

• Various connectors, including both sources and sinks
• Context factories. that potentially integrate with other systems.
• Custom aggregations. These should be generic enough that they should be reusable in other pipelines.

Building from source

To build the project, use the following command

./gradlew build

To publish project modules to the Maven Local repository, use the command

./gradlew publishToMavenLocal

List of modules

InfluxDb Connector

A Hazelcast Jet Connector for InfluxDb which enables Hazelcast Jet pipelines to read/write data points from/to InfluxDb.

Probabilistic Aggregations

A collection of probabilistic aggregations such as HyperLogLog.

Redis Connectors

Hazelcast Jet connectors for various Redis data structures.

MongoDB Connector

A Hazelcast Jet connector for MongoDB for querying/inserting objects from/to MongoDB.

Kafka Connect Connector

A generic Kafka Connect source provides ability to plug any Kafka Connect source for data ingestion to Jet pipelines.

Twitter Connector

A Hazelcast Jet connector for consuming data from Twitter stream sources in Jet pipelines.

Pulsar Connector

A Hazelcast Jet connector for consuming/producing messages from/to Apache Pulsar topics.

XA Tests

Tests to check compatibility of the XA support in your JMS broker or JDBC database with Jet's fault tolerance.

Hazelcast Jet Spring Boot Starter

A Spring Boot Starter for Hazelcast Jet which auto-configures Hazelcast Jet if found on the classpath.

HTTP(S) Listener Source

A Hazelcast Jet source for listening HTTP(S) requests which contains JSON payload.

Snapshot Releases

To access snapshot builds add the following dependency and repository declarations to dependencies and repositories sections in your pom.xml respectively.

<dependency>
  <groupId>com.hazelcast.jet.contrib</groupId>
  <artifactId>${module.name}</artifactId>
  <version>${module.version}</version>
</dependency>

<repository>
    <id>sonatype-snapshots</id>
    <name>Sonatype Snapshot Repository</name>
    <url>https://oss.sonatype.org/content/repositories/snapshots</url>
    <releases>
        <enabled>false</enabled>
    </releases>
    <snapshots>
        <enabled>true</enabled>
    </snapshots>
</repository>

Contributing

We encourage pull requests and process them promptly.

To contribute:

• see Contribution Guideline
• see Developing with Git for our Git process
• see README Template
• complete the Hazelcast Contributor Agreement

Submit your contribution as a pull request on GitHub.

License

This project is licensed under the Apache 2.0 license - see the LICENSE file for details