Benthos v4.10.0 Release Notes

Release Date: 2022-10-26 // over 1 year ago
  • โž• Added

    • ๐Ÿ“‡ The nats_jetstream input now adds a range of useful metadata information to messages.
    • Field transaction_type added to the azure_table_storage output, which deprecates the previous insert_type field and supports interpolation functions.
    • Field logged_batch added to the cassandra output.
    • ๐Ÿ‘ All sql components now support Snowflake.
    • New azure_table_storage input.
    • ๐Ÿ†• New sql_raw input.
    • ๐Ÿ†• New tracing_id bloblang function.
    • ๐Ÿ†• New with bloblang method.
    • Field multi_header added to the kafka and kafka_franz inputs.
    • ๐Ÿ†• New cassandra input.
    • New base64_encode and base64_decode functions for the awk processor.
    • ๐Ÿ“œ Param use_number added to the parse_json bloblang method.
    • Fields init_statement and init_files added to all sql components.
    • ๐Ÿ†• New find and find_all bloblang array methods.

    ๐Ÿ›  Fixed

    • The gcp_cloud_storage output no longer ignores errors when closing a written file, this was masking issues when the target bucket was invalid.
    • โฌ†๏ธ Upgraded the kafka_franz input and output to use github.com/twmb/[email protected] since some bug fixes were made recently.
    • ๐Ÿ›  Fixed an issue where a read_until child input with processors affiliated would block graceful termination.
    • ๐Ÿ‘• The --labels linting option no longer flags resource components.

Previous changes from v4.9.1

  • โž• Added

    • Go API: A new BatchError type added for distinguishing errors of a given batch.

    ๐Ÿ›  Fixed

    • โฌ†๏ธ Rolled back kafka input and output underlying sarama client library to fix a regression introduced in 4.9.0 ๐Ÿ˜… where invalid configuration (Consumer.Group.Rebalance.GroupStrategies and Consumer.Group.Rebalance.Strategy cannot be set at the same time) errors would prevent consumption under certain configurations. We've decided to roll back rather than upgrade as a breaking API change was introduced that could cause issues for Go API importers (more info here: https://github.com/Shopify/sarama/issues/2358).