Skip to content

Latest commit

 

History

History
123 lines (82 loc) · 3.6 KB

README.md

File metadata and controls

123 lines (82 loc) · 3.6 KB

hazelcast-jet-contrib

This repository includes various community supported and incubating modules for Hazelcast Jet.

As a general guideline, the following types of modules are encouraged in this repository:

  • Various connectors, including both sources and sinks
  • Context factories. that potentially integrate with other systems.
  • Custom aggregations. These should be generic enough that they should be reusable in other pipelines.

Building from source

To build the project, use the following command

./gradlew build

To publish project modules to the Maven Local repository, use the command

./gradlew publishToMavenLocal

List of modules

A Hazelcast Jet Connector for InfluxDb which enables Hazelcast Jet pipelines to read/write data points from/to InfluxDb.

A collection of probabilistic aggregations such as HyperLogLog.

Hazelcast Jet connectors for various Redis data structures.

A Hazelcast Jet connector for MongoDB for querying/inserting objects from/to MongoDB.

A generic Kafka Connect source provides ability to plug any Kafka Connect source for data ingestion to Jet pipelines.

A Hazelcast Jet connector for consuming data from Twitter stream sources in Jet pipelines.

A Hazelcast Jet connector for consuming/producing messages from/to Apache Pulsar topics.

Tests to check compatibility of the XA support in your JMS broker or JDBC database with Jet's fault tolerance.

A Spring Boot Starter for Hazelcast Jet which auto-configures Hazelcast Jet if found on the classpath.

A Hazelcast Jet source for listening HTTP(S) requests which contains JSON payload.

Snapshot Releases

To access snapshot builds add the following dependency and repository declarations to dependencies and repositories sections in your pom.xml respectively.

<dependency>
  <groupId>com.hazelcast.jet.contrib</groupId>
  <artifactId>${module.name}</artifactId>
  <version>${module.version}</version>
</dependency>
<repository>
    <id>sonatype-snapshots</id>
    <name>Sonatype Snapshot Repository</name>
    <url>https://oss.sonatype.org/content/repositories/snapshots</url>
    <releases>
        <enabled>false</enabled>
    </releases>
    <snapshots>
        <enabled>true</enabled>
    </snapshots>
</repository>

Contributing

We encourage pull requests and process them promptly.

To contribute:

Submit your contribution as a pull request on GitHub.

License

This project is licensed under the Apache 2.0 license - see the LICENSE file for details