Gollum v0.4.3 Release Notes
-
๐ This is a patch / minor features release. ๐ง It includes several configuration changes for producer.Kafka that might change the runtime behavior. ๐ง Please check your configuration files.
๐ Fixed with 0.4.3
- ๐ Fixed several race conditions reported by Go 1.6 and go build -race
- ๐ Fixed the scribe producer to drop unformatted message in case of error
- ๐ Fixed file.consumer rotation to work on regular files, too
- ๐ Fixed file.consumer rotation to reset the offset file after a SIGHUP
- โก๏ธ Dockerfiles updated
- ๐ Producer.Kafka now sends messages directly to avoid sarama performance bottlenecks
- 0๏ธโฃ consumer.Kafka offset file is properly read on startup if DefaultOffset "oldest" or "newest" is
- ๐ Exisiting unix domain socket detection changed to use create instead of stat (better error handling)
- โก๏ธ Kafka and Scribe specific metrics are now updated if there are no messages, too
- ๐ Scribe producer is now reacting better to server connection errors
- โ Filters and Formatters are now covered with unittests
๐ New with 0.4.3
- ๐ Support for Go1.5 vendor experiment
- ๐ New producer for librdkafka (not included in standard builds)
- Metrics added to show memory consumption
- ๐ New kafka metrics added to show "roundtrip" times for messages
- producer.Benchmark added to get more meaningful core system profiling results
- ๐ New filter filter.Rate added to allow limiting streams to a certain number of messages per second
- โ Added key support to consumer.Kafka and producer.Kafka
- โ Added an "ordered read" config option to consumer.Kafka (round robin reading)
- โ Added a new formater format.ExtractJSON to extract a single value from a JSON object
- ๐จ Go version is now printed with gollum -v
- Scribe producer now queries scribe server status in regular intervals
- ๐ง format.Sequence separator character can now be configured
- ๐ง format.Runlength separator character can now be configured
Other changes with 0.4.3
- ๐ Renamed producer.Kafka BatchTimeoutSec to BatchTimeoutMs to allow millisecond based values
- producer.Kafka retry count set to 0
- 0๏ธโฃ producer.Kafka default producer set to RoundRobin
- 0๏ธโฃ producer.Kafka GracePeriodMs default set to 100
- ๐ producer.Kafka MetadataRefreshMs default set to 600000 (10 minutes)
- 0๏ธโฃ producer.Kafka TimeoutMs default set to 10000 (10 seconds)
- filter.RegExp FilterExpressionNot is evaluated before FilterExpression
- filter.RegExp FilterExpression is evaluated if FilterExpressionNot passed