Gollum v0.4.5 Release Notes

  • ๐Ÿš€ This is a patch / minor features release. โšก๏ธ All vendor dependencies have been updated to the latest version and binaries have been compiled with go 1.8.

    ๐Ÿ›  Fixed with 0.4.5

    • producer.Kafka will discard messages returned as "too large" to avoid spooling
    • consumer.HTTP does not truncate messages with WithHeaders:false anymore (thanks @mhils)
    • producer.Websocket now uses gorilla websockets (thanks @glaslos)
    • ๐Ÿณ Dockerfile is now working again
    • It is now possible to (optionally) send nil messages with producer.kafka again
    • โฑ Consumer.Kinesis will renew the iterator object when hitting a timeout
    • Consumer.Kinesis now runs with an offset file set that does not exist
    • Consumer.Kinesis offset file is now written less often (after each batch)
    • ๐Ÿ‘ป Consumer.Kafka does now retry with an "oldest" offset after encountering an OutOfRange exception.
    • ๐Ÿ›  Fixed a crash when using producer.ElasticSearch with date based indexes (thanks @relud)
    • format.Base64Decode now uses data from previous formatters as intended
    • format.JSON arr and obj will now auto create a key if necessary
    • format.JSON now checks for valid state references upon startup
    • format.JSON now properly encodes strings when using "enc"
    • ๐Ÿ›ฐ format.SplitToJSON may now keep JSON payload and is better at escaping string
    • "gollum -tc" will exit with error code 1 upon error
    • "gollum -tc" will now properly display errors during config checking

    ๐Ÿ†• New with 0.4.5

    • โž• Added producer for writing data to Amazon S3 (thanks @relud)
    • โž• Added authentication support to consumer.HTTP (thanks @glaslos)
    • โž• Added authentication support to native.KafkaProducer (thanks @relud)
    • โž• Added authentication support to producer.Kafka (thanks @relud)
    • โž• Added authentication support to consumer.Kafka (thanks @relud)
    • โž• Added consumer group support to consumer.Kafka (thanks @relud)
    • โž• Added a native SystemD consumer (thanks @relud)
    • โž• Added a Statsd producer for counting messages (thanks @relud)
    • โž• Added an option to flatten JSON arrays into single values with format.ProcessJSON (thanks @relud)
    • โž• Added filter.Any to allow "or" style combinations of filters (thanks @relud)
    • โž• Added support for unix timestamp parsing to format.ProcessJSON (thanks @relud)
    • โž• Added filter.Sample to allow processing of every n'th message only (thanks @relud)
    • โž• Added format.TemplateJSON to apply golang templates to JSON payloads (thanks @relud)
    • โž• Added named pipe support to consumer.Console
    • โž• Added "pick" option to format.ProcessJSON to get a single value from an arrays
    • ๐Ÿšš Extended "remove" option pf format.ProcessJSON to remove values from arrays
    • โž• Added "geoip" option to format.ProcessJSON to get GeoIP data from an IP
    • โž• Added index configuration options to producer.ElasticSearch