Benthos v4.10.0 Release Notes

Release Date: 2022-10-26 // over 1 year ago
  • ➕ Added

    • 📇 The nats_jetstream input now adds a range of useful metadata information to messages.
    • Field transaction_type added to the azure_table_storage output, which deprecates the previous insert_type field and supports interpolation functions.
    • Field logged_batch added to the cassandra output.
    • 👍 All sql components now support Snowflake.
    • New azure_table_storage input.
    • 🆕 New sql_raw input.
    • 🆕 New tracing_id bloblang function.
    • 🆕 New with bloblang method.
    • Field multi_header added to the kafka and kafka_franz inputs.
    • 🆕 New cassandra input.
    • New base64_encode and base64_decode functions for the awk processor.
    • 📜 Param use_number added to the parse_json bloblang method.
    • Fields init_statement and init_files added to all sql components.
    • 🆕 New find and find_all bloblang array methods.

    🛠 Fixed

    • The gcp_cloud_storage output no longer ignores errors when closing a written file, this was masking issues when the target bucket was invalid.
    • ⬆️ Upgraded the kafka_franz input and output to use github.com/twmb/[email protected] since some bug fixes were made recently.
    • 🛠 Fixed an issue where a read_until child input with processors affiliated would block graceful termination.
    • 👕 The --labels linting option no longer flags resource components.

Previous changes from v4.9.1

  • ➕ Added

    • Go API: A new BatchError type added for distinguishing errors of a given batch.

    🛠 Fixed

    • ⬆️ Rolled back kafka input and output underlying sarama client library to fix a regression introduced in 4.9.0 😅 where invalid configuration (Consumer.Group.Rebalance.GroupStrategies and Consumer.Group.Rebalance.Strategy cannot be set at the same time) errors would prevent consumption under certain configurations. We've decided to roll back rather than upgrade as a breaking API change was introduced that could cause issues for Go API importers (more info here: https://github.com/Shopify/sarama/issues/2358).