Awesome
Burrower
A simple tool to calculate the lag of a given consumer group from Burrow and report it to InfluxDB.
Works with:
- InfluxDB 0.9
- Burrow latest (Commit SHA: 7930a61)
Burrower will traverse the Burrow API and retrieve lag metrics for all clusters and consumer groups that are available.
Metrics are sent to InfluxDB with the following values and tags:
Values
- offset
- lag
Tags
- cluster
- consumer_group
- topic
- partition
NOTE: While this code seems stable, it has not been extensively tested. If you have any problems please open an issue (or better yet, a pull request).
Build & Run
git clone https://github.com/splee/burrower.git
cd burrower && sbt assembly
- Update configuration, saving it as
conf/application.conf
(example config file:burrow/conf/application.conf.example
) java -cp target/scala-2.11/burrower-0.2-SNAPSHOT.jar:conf/ com.github.splee.burrower.OffsetMonitor
Planned Features
- Ability to specify any class implmenting
com.github.splee.burrower.write.Writer
to write metrics to custom back ends. - Tests!
- Packaging for Debian with sane defaults and an Upstart configuration.