Gollum v0.4.3 Release Notes

  • ๐Ÿš€ This is a patch / minor features release. ๐Ÿ”ง It includes several configuration changes for producer.Kafka that might change the runtime behavior. ๐Ÿ”ง Please check your configuration files.

    ๐Ÿ›  Fixed with 0.4.3

    • ๐Ÿ›  Fixed several race conditions reported by Go 1.6 and go build -race
    • ๐Ÿ›  Fixed the scribe producer to drop unformatted message in case of error
    • ๐Ÿ›  Fixed file.consumer rotation to work on regular files, too
    • ๐Ÿ›  Fixed file.consumer rotation to reset the offset file after a SIGHUP
    • โšก๏ธ Dockerfiles updated
    • ๐ŸŽ Producer.Kafka now sends messages directly to avoid sarama performance bottlenecks
    • 0๏ธโƒฃ consumer.Kafka offset file is properly read on startup if DefaultOffset "oldest" or "newest" is
    • ๐Ÿ‘ Exisiting unix domain socket detection changed to use create instead of stat (better error handling)
    • โšก๏ธ Kafka and Scribe specific metrics are now updated if there are no messages, too
    • ๐Ÿ‘ Scribe producer is now reacting better to server connection errors
    • โœ… Filters and Formatters are now covered with unittests

    ๐Ÿ†• New with 0.4.3

    • ๐Ÿ‘Œ Support for Go1.5 vendor experiment
    • ๐Ÿ†• New producer for librdkafka (not included in standard builds)
    • Metrics added to show memory consumption
    • ๐Ÿ†• New kafka metrics added to show "roundtrip" times for messages
    • producer.Benchmark added to get more meaningful core system profiling results
    • ๐Ÿ†• New filter filter.Rate added to allow limiting streams to a certain number of messages per second
    • โž• Added key support to consumer.Kafka and producer.Kafka
    • โž• Added an "ordered read" config option to consumer.Kafka (round robin reading)
    • โž• Added a new formater format.ExtractJSON to extract a single value from a JSON object
    • ๐Ÿ–จ Go version is now printed with gollum -v
    • Scribe producer now queries scribe server status in regular intervals
    • ๐Ÿ”ง format.Sequence separator character can now be configured
    • ๐Ÿ”ง format.Runlength separator character can now be configured

    Other changes with 0.4.3

    • ๐Ÿ“‡ Renamed producer.Kafka BatchTimeoutSec to BatchTimeoutMs to allow millisecond based values
    • producer.Kafka retry count set to 0
    • 0๏ธโƒฃ producer.Kafka default producer set to RoundRobin
    • 0๏ธโƒฃ producer.Kafka GracePeriodMs default set to 100
    • ๐Ÿ“‡ producer.Kafka MetadataRefreshMs default set to 600000 (10 minutes)
    • 0๏ธโƒฃ producer.Kafka TimeoutMs default set to 10000 (10 seconds)
    • filter.RegExp FilterExpressionNot is evaluated before FilterExpression
    • filter.RegExp FilterExpression is evaluated if FilterExpressionNot passed