All Versions
21
Latest Version
Avg Release Cycle
97 days
Latest Release
265 days ago
Changelog History
Page 1
Changelog History
Page 1
-
v2.0.0 Changes
July 04, 2022๐ฅ Breaking changes
- โฌ๏ธ Dropped inline comment feature for
run
command. Previously s5cmd supported a command with an inline comment likels s3://bucket/object.gz # inline comment
. (#309) - ๐ Changed homebrew installation command on macOS. Users can install s5cmd via
brew install peak/tap/s5cmd
. (#356) - ๐จ Print usage errors to stderr instead of stdout and do not show help text on usage error. (#399)
- ๐ณ Working directory of the Docker image changed to
/aws
from/
. (#412)
๐ Features
- โ Added
sync
command to synchronize two given buckets, prefixes, or objects. (#3) - โ Added AWS Single Sign-On (SSO) profiles support. (#385)
- โ Added
--force-glacier-transfer
flag toselect
command. (#346) - โ Added
--ignore-glacier-warnings
flag tocp
,mv
andselect
commands. (#346) - โ Added
--request-payer
flag to includex-amz-request-payer
in header while sending GET, POST and HEAD requests. (#297) @Kirill888 - โ Added
--use-list-objects-v1
flag to force using S3 ListObjects API instead of ListObjectsV2 API. (#405) @greenpau - โ Added trace log level(
--log=trace
) which enables SDK debug logs.(#363)
๐ Improvements
- โฌ๏ธ Upgraded minimum required Go version to 1.16.
๐ Bugfixes
- ๐ Fixed a bug about precedence of region detection, which auto region detection would always override region defined in environment or profile. (#325)
- ๐ Fixed a bug where errors did not result a non-zero exit code. (#304)
- ๐จ Print error if the commands file of
run
command is not accessible. (#410) - โก๏ธ Updated region detection call to use current session's address resolving method (#314)
- ๐ Fixed a bug where lines with large tokens fail in
run
command.sync
was failing when it finds multiple files to remove. (#435, #436) - ๐จ Print usage error if given log level(
--log
) is not valid. (#430) - ๐ Fixed a bug where (
--stat
) is ignored when log level is error. (#359)
- โฌ๏ธ Dropped inline comment feature for
-
v1.4.0 Changes
September 21, 2021๐ Features
- โ Added
select
command. It allows to select JSON records from objects using SQL expressions. (#299) @skeggse - โ Added
rb
command to remove buckets. (#303). - โ Added
--exclude
flag tocp
,rm
,ls
,du
andselect
commands. This flag allows users to exclude objects with given pattern. (#266) - โ Added
--raw
flag tocp
andrm
commands. It disables the wildcard operations. It is useful when an object contains glob characters which interfers with glob expansion logic. (#235) - โ Added
--cache-control
and--expires
flags tocp
andmv
commands. It adds support for setting cache control and expires header to S3 objects. (#318) @tombokombo - โ Added
--force-glacier-transfer
flag tocp
command. It forces a transfer request on all Glacier objects. (#206) - โ Added
--source-region
anddestination-region
flags tocp
command. It allows overriding bucket region. (#262) @kemege
๐ Improvements
- โ Added
MacPorts
installation option. (#311) @manojkarthick - Added
S3_ENDPOINT_URL
environment variable (#343) @Dexus - Prevent retries if a token related error is received (#337)
๐ Bugfixes
- ๐ Change the order of precedence in URL expansion in file system. Glob (*) expansion have precedence over directory expansion. (#322)
- ๐ Fixed data race for concurrent writes for expand (#330)
- ๐ Fixed concurrent writes to the flags list of run command (#335)
- ๐ Fixed options usage on mv command (#338)
- โ Added
-
v1.3.0 Changes
July 01, 2021๐ Features
- โ Added global
--no-sign-request
flag. API requests won't be signed and credentials won't be used if this option is provided. It is useful for accessing public buckets. (#285)
๐ Improvements
- ๐ If retryable errors are received during command execution, users now can see what's happening under the hood. (#261)
- ๐ Update documentation about the AWS_PROFILE environment variable. (#275) @davebiffuk
๐ Bugfixes
- โ Added global
-
v1.2.1 Changes
December 03, 2020 -
v1.2.0 Changes
November 05, 2020๐ With this release,
s5cmd
automatically determines region information of destination buckets.๐ Features
- โ Added global
--dry-run
option. It displays which command(s) will be executed without actually having a side effect. (#90) - โ Added
--stat
option fors5cmd
and it displays program execution statistics before the end of the program output. (#148) - โ Added cross-region transfer support. Bucket regions are inferred, thus, supporting cross-region transfers and multiple regions in batch mode. (#155)
๐ Bugfixes
- ๐ Fixed incorrect MIME type inference for
cp
, give priority to file extension for type inference. (#214) - ๐ Fixed error reporting issue, where some errors from the
ls
operation were not printed.
๐ Improvements
- Requests to different buckets not allowed in
rm
batch operation, i.e., throw an error. - AWS S3
RequestTimeTooSkewed
request error was not retryable before, it is now. (205) - ๐จ For some operations errors were printed at the end of the program execution. Now, errors are displayed immediately after being detected. (#136)
- ๐ณ From now on, docker images will be published on Docker Hub. (#238)
- ๐ Changed misleading 'mirroring' examples in the help text of
cp
. (#213)
- โ Added global
-
v1.1.0 Changes
July 22, 2020๐ With this release, Windows is supported.
๐ฅ Breaking changes
- โฌ๏ธ Dropped storage class short codes display from default behaviour of
ls
operation. Instead, use-s
flag withls
๐ to see full names of the storage classes when listing objects.
๐ Features
- โ Added Server-side Encryption (SSE) support for mv/cp operations. It uses customer master keys (CMKs) managed by AWS Key Management Service. (#18)
- โ Added an option to show full form of storage class when listing objects. (#165)
- โ Add access control lists (ACLs) ๐ support to enable managing access to buckets and objects. (#26)
๐ Bugfixes
- ๐ Fixed infinite repetition issue on mv/cp operations which would occur if the destination matched the source wildcard. (#168)
- ๐ Fixed windows filepath issue, where backslashes should be treated as the path delimiter. (#178)
- ๐ All tests pass on windows, by converting and treating file paths to UNIX filepath format.
- ๐ Fixed a transfer issue where the object path contains particular regex metacharacters. (#111) @brendan-matroid
- ๐ Correctly parse object paths that contain whitespaces in run-mode. (#111) @brendan-matroid
๐ Improvements
- Retry when connection closed by S3 unexpectedly. (#189) @eminugurkenar
- โฌ๏ธ Dropped storage class short codes display from default behaviour of
-
v1.0.0 Changes
April 01, 2020๐ This is a major release with many breaking changes.
๐ฅ Breaking changes
- โฌ๏ธ Dropped
get
command. Users could get the same effect withs5cmd cp <src> .
. - โฌ๏ธ Dropped
nested command
support. - โฌ๏ธ Dropped
!
command. It was used to execute shell commands and was used in conjunction with nested commands. s5cmd -f
ands5cmd -f -
usage has changed tos5cmd run
.run
command accepts a file. If not provided, it'll listen for commands from stdin.- Exit code for errors was
127
. It is1
now. - โฌ๏ธ Dropped
exit
command. It was used to change the shell exit code and usually a part of the nested command usage. - โฌ๏ธ Dropped local->local copy and move support. (#118)
- All error messages are sent to stderr now.
-version
flag is changed toversion
command.- โฌ๏ธ Dropped
batch-rm
command. It was not listed in the help output. Now that we support variadic arguments, users can remove multiple objects by providing wildcards or multiple arguments tos5cmd rm
command. (#106) - ๐
Virtual host style bucket name
resolving
is enabled by default for S3 and GCS. If you provide a custom endpoint via
--endpoint-url
flag (other than GCS and S3 transfer acceleration),s5cmd
will fall back to thepath-style
. (#92) - Listing a non-existent object will return exit code
1
, instead of0
. (#23) -ds
,-dw
,-us
and-uw
global flags are no longer available. Multipart concurrency and part size flags are now part of thecp/mv
command. New replacement flags are--concurrency | -c
and--part-size | -p
. (#110)- 0๏ธโฃ s5cmd
cp
command follows symbolic links by default (only when uploading to s3 from local filesystem). Use--no-follow-symlinks
flag to disable this feature. (#17) - โฌ๏ธ Dropped
-parents
flag from copy command. Copy behaviour has changed to preserve the directory hierarchy as a default. Optional-flatten
flag is added to flatten directory structure. (#107) - โฌ๏ธ Dropped
-vv
verbosity flag.--log
flag is introduced.
๐ Features
- โ Added
mb
command to make buckets. (#25) - โ Added
--json
flag for JSON logging. (#22) - โ Added S3 transfer acceleration support. (#40)
- โ Added Google Cloud Storage support. (#81)
- โ Added
cat
command to print remote object contents to stdout (#20)
๐ Bugfixes
- Correctly set
Content-Type
of a file on upload operations. (#33) - ๐ Fixed a bug where workers are unable to consume job if there are too many outstanding wildcard expansion requests. (#12, #58)
๐ Improvements
- ๐ Pre-compiled binaries are provided on releases page. (#21)
- โก๏ธ AWS Go SDK is updated to support IAM role for service accounts. (#32)
- ๐ For copy/move operations,
s5cmd
now creates destination directory if missing. - Increase the soft limit of open files to 1000 and exits immediately when it encounters
too many open files
error. (#52)
- โฌ๏ธ Dropped
-
v0.7.2
February 19, 2020 -
v0.7.1
February 05, 2020 -
v0.7.0 Changes
January 27, 2020- ๐ Use go modules.
- โก๏ธ Update minimum required Go version to 1.13.