put

Put a file from a source path (local or remote), to a destination.

  • Uses the newer openFile/createFile API calls and allows for a property file listing options to set on the createFile call.
  • Prints IO statistics
  • Supports the -debug mode for a low level trace of the network IO.
bin/hadoop jar cloudstore-1.6.jar put -options options -debug bin/hadoop s3a://target-london/hadoop

Here the options file adds a custom header to the object, and forces multipart IO on hadoop releases with HADOOP-19256.S3A: Support S3 Conditional Writes (Hadoop 3.4.2+).

# add a header, just PoC
fs.s3a.create.header.custom-header=value
# force multipart
fs.s3a.create.multipart=true