Skip to content
forked from splee/burrower

A small project to report offset lag for Kafka Consumer Groups via Burrow.

Notifications You must be signed in to change notification settings

Omnistac/burrower

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Burrower

A simple tool to calculate the lag of a given consumer group from Burrow and report it to InfluxDB.

Works with:

  • InfluxDB 0.9
  • Burrow latest (Commit SHA: 7930a61)

Burrower will traverse the Burrow API and retrieve lag metrics for all clusters and consumer groups that are available.

Metrics are sent to InfluxDB with the following values and tags:

Values

  • offset
  • lag

Tags

  • cluster
  • consumer_group
  • topic
  • partition

NOTE: While this code seems stable, it has not been extensively tested. If you have any problems please open an issue (or better yet, a pull request).

Build & Run

  1. git clone https://github.com/splee/burrower.git
  2. cd burrower && sbt assembly
  3. Update configuration, saving it as conf/application.conf (example config file: burrow/conf/application.conf.example)
  4. java -cp target/scala-2.11/burrower-0.2-SNAPSHOT.jar:conf/ com.github.splee.burrower.OffsetMonitor

Planned Features

  • Ability to specify any class implmenting com.github.splee.burrower.write.Writer to write metrics to custom back ends.
  • Tests!
  • Packaging for Debian with sane defaults and an Upstart configuration.

About

A small project to report offset lag for Kafka Consumer Groups via Burrow.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Scala 100.0%