s5cmd v1.0.0 Release Notes

Release Date: 2020-04-01 // about 4 years ago
  • ๐Ÿš€ This is a major release with many breaking changes.

    ๐Ÿ’ฅ Breaking changes

    • โฌ‡๏ธ Dropped get command. Users could get the same effect with s5cmd cp <src> ..
    • โฌ‡๏ธ Dropped nested command support.
    • โฌ‡๏ธ Dropped ! command. It was used to execute shell commands and was used in conjunction with nested commands.
    • s5cmd -f and s5cmd -f - usage has changed to s5cmd run. run command accepts a file. If not provided, it'll listen for commands from stdin.
    • Exit code for errors was 127. It is 1 now.
    • โฌ‡๏ธ Dropped exit command. It was used to change the shell exit code and usually a part of the nested command usage.
    • โฌ‡๏ธ Dropped local->local copy and move support. (#118)
    • All error messages are sent to stderr now.
    • -version flag is changed to version command.
    • โฌ‡๏ธ Dropped batch-rm command. It was not listed in the help output. Now that we support variadic arguments, users can remove multiple objects by providing wildcards or multiple arguments to s5cmd rm command. (#106)
    • ๐Ÿ’… Virtual host style bucket name resolving is enabled by default for S3 and GCS. If you provide a custom endpoint via --endpoint-url flag (other than GCS and S3 transfer acceleration), s5cmd will fall back to the path-style. (#92)
    • Listing a non-existent object will return exit code 1, instead of 0. (#23)
    • -ds, -dw, -us and -uw global flags are no longer available. Multipart concurrency and part size flags are now part of the cp/mv command. New replacement flags are --concurrency | -c and --part-size | -p. (#110)
    • 0๏ธโƒฃ s5cmd cp command follows symbolic links by default (only when uploading to s3 from local filesystem). Use --no-follow-symlinks flag to disable this feature. (#17)
    • โฌ‡๏ธ Dropped -parents flag from copy command. Copy behaviour has changed to preserve the directory hierarchy as a default. Optional -flatten flag is added to flatten directory structure. (#107)
    • โฌ‡๏ธ Dropped -vv verbosity flag. --log flag is introduced.

    ๐Ÿ”‹ Features

    ๐Ÿ›  Bugfixes

    • Correctly set Content-Type of a file on upload operations. (#33)
    • ๐Ÿ›  Fixed a bug where workers are unable to consume job if there are too many outstanding wildcard expansion requests. (#12, #58)

    ๐Ÿ‘Œ Improvements

    • ๐Ÿš€ Pre-compiled binaries are provided on releases page. (#21)
    • โšก๏ธ AWS Go SDK is updated to support IAM role for service accounts. (#32)
    • ๐Ÿšš For copy/move operations, s5cmd now creates destination directory if missing.
    • Increase the soft limit of open files to 1000 and exits immediately when it encounters too many open files error. (#52)