Loading from S3-Compatible Object Storage ​

In general, follow the instructions in Loading from Amazon S3, using the S3 Object Storage URIs and S3 Authentication Methods. Before attempting to run ybload, you must already have an account with the S3-compatible object storage provider, know the S3 location of the files you want to load, and have your S3 credentials ready at hand. Your storage provider may have other requirements; please refer to the provider's documentation for details.

The ybload client supports S3 Java SDK v2, which requires that a region be supplied and configured even if your S3-compatible object store does not in itself require or support regions.
 If a region is not provided, connections to the object store will fail. To work around this requirement, you can specify a "dummy" region.

For example, if you are working exclusively with S3-compatible object stores, you can use an AWS configuration file to provide the dummy value:

~/.aws/config
[default]
region = dummy

Note that the yb.file. prefix is not supported in this context.

You can only access one object store per ybload operation. For example, you cannot load data from multiple S3 endpoints or storage accounts in a single command.

Parent topic:Loading Data from Object Storage