All Versions
287
Latest Version
Avg Release Cycle
16 days
Latest Release
519 days ago

Changelog History
Page 1

  • v4.10.0 Changes

    October 26, 2022

    โž• Added

    • ๐Ÿ“‡ The nats_jetstream input now adds a range of useful metadata information to messages.
    • Field transaction_type added to the azure_table_storage output, which deprecates the previous insert_type field and supports interpolation functions.
    • Field logged_batch added to the cassandra output.
    • ๐Ÿ‘ All sql components now support Snowflake.
    • New azure_table_storage input.
    • ๐Ÿ†• New sql_raw input.
    • ๐Ÿ†• New tracing_id bloblang function.
    • ๐Ÿ†• New with bloblang method.
    • Field multi_header added to the kafka and kafka_franz inputs.
    • ๐Ÿ†• New cassandra input.
    • New base64_encode and base64_decode functions for the awk processor.
    • ๐Ÿ“œ Param use_number added to the parse_json bloblang method.
    • Fields init_statement and init_files added to all sql components.
    • ๐Ÿ†• New find and find_all bloblang array methods.

    ๐Ÿ›  Fixed

    • The gcp_cloud_storage output no longer ignores errors when closing a written file, this was masking issues when the target bucket was invalid.
    • โฌ†๏ธ Upgraded the kafka_franz input and output to use github.com/twmb/[email protected] since some bug fixes were made recently.
    • ๐Ÿ›  Fixed an issue where a read_until child input with processors affiliated would block graceful termination.
    • ๐Ÿ‘• The --labels linting option no longer flags resource components.
  • v4.9.1 Changes

    October 06, 2022

    โž• Added

    • Go API: A new BatchError type added for distinguishing errors of a given batch.

    ๐Ÿ›  Fixed

    • โฌ†๏ธ Rolled back kafka input and output underlying sarama client library to fix a regression introduced in 4.9.0 ๐Ÿ˜… where invalid configuration (Consumer.Group.Rebalance.GroupStrategies and Consumer.Group.Rebalance.Strategy cannot be set at the same time) errors would prevent consumption under certain configurations. We've decided to roll back rather than upgrade as a breaking API change was introduced that could cause issues for Go API importers (more info here: https://github.com/Shopify/sarama/issues/2358).
  • v4.9.0 Changes

    October 03, 2022

    โž• Added

    • ๐Ÿ†• New parquet input for reading a batch of Parquet files from disk.
    • Field max_in_flight added to the redis_list input.

    ๐Ÿ›  Fixed

    • โฌ†๏ธ Upgraded kafka input and output underlying sarama client library to fix a regression introduced in 4.7.0 where The requested offset is outside the range of offsets maintained by the server for the given topic/partition errors would prevent consumption of partitions.
    • The cassandra output now inserts logged batches of data rather than the less efficient (and unnecessary) unlogged form.
  • v4.8.0 Changes

    September 30, 2022

    โž• Added

    • ๐Ÿ‘ All sql components now support Oracle DB.

    ๐Ÿ›  Fixed

    • All SQL components now accept an empty or unspecified args_mapping as an alias for no arguments.
    • Field unsafe_dynamic_query added to the sql_raw output.
    • ๐Ÿ›  Fixed a regression in 4.7.0 where HTTP client components were sending duplicate request headers.
  • v4.7.0 Changes

    September 27, 2022

    โž• Added

    • Field avro_raw_json added to the schema_registry_decode processor.
    • Field priority added to the gcp_bigquery_select input.
    • ๐Ÿ‘ The hash bloblang method now supports crc32.
    • ๐Ÿ†• New tracing_span bloblang function.
    • ๐Ÿ‘ All sql components now support SQLite.
    • ๐Ÿ†• New beanstalkd input and output.
    • Field json_marshal_mode added to the mongodb input.
    • The schema_registry_encode and schema_registry_decode processors now support Basic, OAuth and JWT authentication.

    ๐Ÿ›  Fixed

    • The streams mode /ready endpoint no longer returns status 503 for streams that gracefully finished.
    • ๐ŸŽ The performance of the bloblang .explode method now scales linearly with the target size.
    • The influxdb and logger metrics outputs should no longer mix up tag names.
    • ๐Ÿ›  Fix a potential race condition in the read_until connect check on terminated input.
    • The parse_parquet bloblang method and parquet_decode processor now automatically parse BYTE_ARRAY values as strings when the logical type is UTF8.
    • The gcp_cloud_storage output now correctly cleans up temporary files on error conditions when the collision mode is set to append.
  • v4.6.0 Changes

    August 31, 2022

    โž• Added

    • ๐Ÿ†• New squash bloblang method.
    • ๐Ÿ†• New top-level config field shutdown_delay for delaying graceful termination.
    • ๐Ÿ†• New snowflake_id bloblang function.
    • Field wait_time_seconds added to the aws_sqs input.
    • ๐Ÿ†• New json_path bloblang method.
    • New file_json_contains predicate for unit tests.
    • ๐Ÿ‘ The parquet_encode processor now supports the UTF8 logical type for columns.

    ๐Ÿ›  Fixed

    • The schema_registry_encode processor now correctly assumes Avro JSON encoded documents by default.
    • ๐Ÿ‘• The redis processor retry_period no longer shows linting errors for duration strings.
    • The /inputs and /outputs endpoints for dynamic inputs and outputs now correctly render configs, both structured within the JSON response and the raw config string.
    • ๐Ÿ— Go API: The stream builder no longer ignores http configuration. Instead, the value of http.enabled is set to false by default.
  • v4.5.1 Changes

    August 10, 2022

    ๐Ÿ›  Fixed

    • โช Reverted kafka_franz dependency back to 1.3.1 due to a regression in TLS/SASL commit retention.
    • ๐Ÿ›  Fixed an unintentional linting error when using interpolation functions in the elasticsearch outputs action field.
  • v4.5.0 Changes

    August 07, 2022

    โž• Added

    • Field batch_size added to the generate input.
    • The amqp_0_9 output now supports setting the timeout of publish.
    • ๐Ÿ†• New experimental input codec avro-ocf:marshaler=x.
    • ๐Ÿ†• New mapping and mutation processors.
    • New parse_form_url_encoded bloblang method.
    • The amqp_0_9 input now supports setting the auto-delete bit during queue declaration.
    • New open_telemetry_collector tracer.
    • ๐Ÿ‘ The kafka_franz input and output now supports no-op SASL options with the mechanism none.
    • Field content_type added to the gcp_cloud_storage cache.

    ๐Ÿ›  Fixed

    • The mongodb processor and output default write_concern.w_timeout empty value no longer causes configuration issues.
    • Field message_name added to the logger config.
    • ๐Ÿ”Š The amqp_1 input and output should no longer spam logs with timeout errors during graceful termination.
    • ๐Ÿ›  Fixed a potential crash when the contains bloblang method was used to compare complex types.
    • ๐Ÿ›  Fixed an issue where the kafka_franz input or output wouldn't use TLS connections without custom certificate configuration.
    • ๐Ÿ›  Fixed structural cycle in the CUE representation of the retry output.
    • Tracing headers from HTTP requests to the http_server input are now correctly extracted.

    ๐Ÿ”„ Changed

    • ๐Ÿ“š The broker input no longer applies processors before batching as this was unintentional behaviour and counter to documentation. Users that rely on this behaviour are advised to place their pre-batching processors at the level of the child inputs of the broker.
    • ๐Ÿ“š The broker output no longer applies processors after batching as this was unintentional behaviour and counter to documentation. Users that rely on this behaviour are advised to place their post-batching processors at the level of the child outputs of the broker.
  • v4.4.1 Changes

    July 19, 2022

    ๐Ÿ›  Fixed

    • ๐Ÿ›  Fixed an issue where an http_server input or output would fail to register prometheus metrics when combined with other inputs/outputs.
    • ๐Ÿ›  Fixed an issue where the jaeger tracer was incapable of sending traces to agents outside of the default port.
  • v4.4.0 Changes

    July 18, 2022

    โž• Added

    • ๐Ÿ‘ The service-wide http config now supports basic authentication.
    • ๐Ÿ‘ The elasticsearch output now supports upsert operations.
    • ๐Ÿ†• New fake bloblang function.
    • New parquet_encode and parquet_decode processors.
    • ๐Ÿ†• New parse_parquet bloblang method.
    • CLI flag --prefix-stream-endpoints added for disabling streams mode API prefixing.
    • Field timestamp_name added to the logger config.