Awesome
S3 Performance Test Tool
Performance test tool for Amazon S3 or S3-compatible object storage systems like Ceph with radosgw.
Build:
(requires Java 8 or higher)
mvn clean install
Usage by example:
UPLOAD of n randomly generated files (key = UUID), each 2kB size
java -jar target/s3pt.jar --accessKey <accessKey> --secretKey <secretKey> --bucketName <bucketName> -n <number of files to upload> --size 2048
RANDOM_READ with 4 parallel threads, each 10.000 reads = 40.000 requests
java -jar target/s3pt.jar --accessKey <accessKey> --secretKey <secretKey> --bucketName <bucketName> --operation=RANDOM_READ -n 10000 -t 4
General usage:
java -jar s3pt.jar [options...]
--accessKey VAL : access key ID; also possible to set AWS_ACCESS_KEY int
environment
--bucketName VAL : name of bucket
--endpointUrl VAL : endpoint url (default: s3.amazonaws.com)
--gzip : use gzip (default: false)
--http : use http instead of https (default: false)
--keepAlive : use TCP keep alive (default: false)
--keyFileName VAL : name of file with object keys
--operation VAL : operation (default: UPLOAD)
--secretKey VAL : secret access key; also possible to set AWS_SECRET_KEY
in environment
--signerOverride VAL : override the S3 signer (e.g. 'S3Signer' or
'AWSS3V4Signer')
--size N : file size (e.g. for UPLOAD); supported units: B, K, M
(default: 131072)
--usePathStyleAccess : use path-style access (instead of DNS-style) (default:
false)
-n (--number) N : number of operations
-t (--threads) N : number of threads (default: 1)
To print the usage information execute java -jar target/s3pt.jar
on the command line.