All Versions
273
Latest Version
Avg Release Cycle
14 days
Latest Release
78 days ago
Changelog History
Page 1
Changelog History
Page 1
-
v3.65.0 Changes
March 07, 2022โ Added
- ๐ New
sql_raw
processor and output.
๐ Fixed
- Corrected a case where nested
parallel
processors that result in emptied batches (all messages filtered) would propagate an unack rather than an acknowledgement.
๐ Changed
- ๐ The
sql
processor and output are no longer marked as deprecated and will therefore not be removed in V4. This change was made in order to provide more time to migrate to the newsql_raw
processor and output.
- ๐ New
-
v3.64.0 Changes
February 23, 2022โ Added
- Field
nack_reject_patterns
added to theamqp_0_9
input. - ๐ New experimental
mongodb
input. - ๐ Field
cast
added to thexml
processor andparse_xml
bloblang method. - New experimental
gcp_bigquery_select
processor. - ๐ New
assign
bloblang method. - ๐ The
protobuf
processor now supportsAny
fields in protobuf definitions. - The
azure_queue_storage
input fieldqueue_name
now supports interpolation functions.
๐ Fixed
- ๐ Fixed an issue where manually clearing errors within a
catch
processor would result in subsequent processors in the block being skipped. - The
cassandra
output should now automatically matchfloat
columns. - ๐ Fixed an issue where the
elasticsearch
output would collapse batched messages of matching ID rather than send as individual items. - ๐ Running streams mode with
--no-api
no longer removes the/ready
endpoint.
๐ Changed
- ๐ The
throttle
processor has now been marked as deprecated.
- Field
-
v3.63.0 Changes
February 08, 2022โ Added
- ๐ Field
cors
added to thehttp_server
input and output, for supporting CORS requests when custom servers are used. - Field
server_side_encryption
added to theaws_s3
output. - Field
use_histogram_timing
andhistogram_buckets
added to theprometheus
metrics exporter. - ๐ New duration string and back off field types added to plugin config builders.
- Experimental field
multipart
added to thehttp_client
output. - Codec
regex
added to inputs. - โฑ Field
timeout
added to thecassandra
output. - New experimental
gcp_bigquery_select
input. - Field
ack_wait
added to thenats_jetstream
input.
๐ Changed
- ๐
The old map-style resource config fields (
resources.processors.<name>
, etc) are now marked as deprecated. Use the newer list based fields (processor_resources
, etc) instead.
๐ Fixed
- ๐ The
generate
input now supports zeroed duration strings (0s
, etc) for unbounded document creation. - The
aws_dynamodb_partiql
processor no longer ignores theendpoint
field. - Corrected duplicate detection for custom cache implementations.
- ๐ Fixed panic caused by invalid bounds in the
range
function. - โ
Resource config files imported now allow (and ignore) a
tests
field. - ๐ Fixed an issue where the
aws_kinesis
input would fail to back off during unyielding read attempts. - ๐ Fixed a linting error with
zmq4
input/outputurls
fields that was incorrectly expecting a string.
- ๐ Field
-
v3.62.0 Changes
January 21, 2022โ Added
- ๐ Field
sync
added to thegcp_pubsub
input. - ๐ New input, processor, and output config field types added to the plugin APIs.
- โ Added new experimental
parquet
processor. - ๐ New Bloblang method
format_json
. - ๐ Field
collection
inmongodb
processor and output now supports interpolation functions. - Field
output_raw
added to thejq
processor. - The lambda distribution now supports a
BENTHOS_CONFIG_PATH
environment variable for specifying a custom config path. - ๐ Field
metadata
added tohttp
andhttp_client
components. - Field
ordering_key
added to thegcp_pubsub
output. - A suite of new experimental
geoip_
methods have been added. - โ Added flag
--deprecated
to thebenthos lint
subcommand for detecting deprecated fields.
๐ Changed
- The
sql
processor and output have been marked deprecated in favour of the newersql_insert
,sql_select
alternatives.
๐ Fixed
- The input codec
chunked
is no longer capped by the packet size of the incoming streams. - The
schema_registry_decode
andschema_registry_encode
processors now honour trailing slashes in theurl
field. - ๐ง Processors configured within
pipeline.processors
now share processors across threads rather than clone them. - ๐ Go API: Errors returned from input/output plugin
Close
methods no longer cause shutdown to block. - ๐ง The
pulsar
output should now follow authentication configuration. - ๐ Fixed an issue where the
aws_sqs
output might occasionally retry a failed message send with an invalid empty message body.
- ๐ Field
-
v3.61.0 Changes
December 28, 2021โ Added
- Field
json_marshal_mode
added to the MongoDB processor. - Fields
extract_headers.include_prefixes
andextract_headers.include_patterns
added to thehttp_client
input and output and to thehttp
processor. - ๐ Fields
sync_response.metadata_headers.include_prefixes
andsync_response.metadata_headers.include_patterns
added to thehttp_server
input. - The
http_client
input and output and thehttp
processor fieldcopy_response_headers
has been deprecated in favour of theextract_headers
functionality. - โ Added new cli flag
--no-api
for thestreams
subcommand to disable the REST API. - ๐ New experimental
kafka_franz
input and output. - โ Added new Bloblang function
ksuid
. - ๐ All
codec
input fields now support custom csv delimiters.
๐ Fixed
- Streams mode paths now resolve glob patterns in all cases.
- ๐ฒ Prevented the
nats
input from error logging when acknowledgments can't be fulfilled due to the lack of message replies. - ๐ Fixed an issue where GCP inputs and outputs could terminate requests early due to a cancelled client context.
- ๐ Prevented more parsing errors in Bloblang mappings with windows style line endings.
- Field
-
v3.60.1 Changes
December 03, 2021๐ Fixed
- ๐ Fixed an issue where the
mongodb
output would incorrectly report upsert not allowed on valid operators.
- ๐ Fixed an issue where the
-
v3.60.0 Changes
December 01, 2021โ Added
- ๐ The
pulsar
input and output now supportoauth2
andtoken
authentication mechanisms. - ๐ The
pulsar
input now enriches messages with more metadata. - Fields
message_group_id
,message_deduplication_id
, andmetadata
added to theaws_sns
output. - Field
upsert
added to themongodb
processor and output.
๐ Fixed
- The
schema_registry_encode
andschema_registry_decode
processors now honour path prefixes included in theurl
field. - The
mqtt
input and outputkeepalive
field is now interpreted as seconds, previously it was being erroneously interpreted as nanoseconds. - ๐ The header
Content-Type
in the fieldhttp_server.sync_response.headers
is now detected in a case insensitive way when populating multipart message encoding types. - The
nats_jetstream
input and outputs should now honourauth.*
config fields.
- ๐ The
-
v3.59.0 Changes
November 22, 2021โ Added
- New Bloblang method
parse_duration_iso8601
for parsing ISO-8601 duration strings into an integer. - ๐ The
nats
input now supports metadata from headers when supported. - Field
headers
added to thenats
output. - Go API: Optional field definitions added for config specs.
- ๐ New (experimental)
sql_select
input. - New (experimental)
sql_select
andsql_insert
processors, which will supersede the existingsql
processor. - ๐ New (experimental)
sql_insert
output, which will supersede the existingsql
output. - Field
retained_interpolated
added to themqtt
output. - Bloblang now allows optional carriage returns before line feeds at line endings.
- ๐ New CLI flag
-w
/-watcher
added for automatically detecting and applying configuration file changes. - Field
avro_raw_json
added to theschema_registry_encode
processor. - ๐ New (experimental)
msgpack
processor. - New
parse_msgpack
andformat_msgpack
Bloblang methods.
๐ Fixed
- Fixed an issue where the
azure_table_storage
output would attempt to send >100 size batches (and fail). - ๐ Fixed an issue in the
subprocess
input where saturated stdout streams could become corrupted.
- New Bloblang method
-
v3.58.0 Changes
November 02, 2021โ Added
amqp_0_9
components now support TLS EXTERNAL auth.- Field
urls
added to theamqp_0_9
input and output. - New experimental
schema_registry_encode
processor. - โฑ Field
write_timeout
added to themqtt
output, and fieldconnect_timeout
added to both the input and output. - ๐ง The
websocket
input and output now support customtls
configuration. - ๐ New output broker type
fallback
added as a drop-in replacement for the now deprecatedtry
broker.
๐ Fixed
- โ Removed a performance bottleneck when consuming a large quantity of small files with the
file
input.
-
v3.57.0 Changes
October 14, 2021โ Added
- Go API: New config field types
StringMap
,IntList
, andIntMap
. - ๐ The
http_client
input, output and processor now include the response body in request error logs for more context. - Field
dynamic_client_id_suffix
added to themqtt
input and output.
๐ Fixed
- Corrected an issue where the
sftp
input could consume duplicate documents before shutting down when ran in batch mode.
- Go API: New config field types