nucleardog
/
mass_s3
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
Tool for running S3 operations against a lot of objects at once.
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
5 Commits
1 Branch
0 Tags
84 KiB
 
Branch: master
Branches Tags
${ item.name }
Create tag ${ searchTerm }
Create branch ${ searchTerm }
from 'master'
${ noResults }
Adam Pippin 5e6f93d43a
Add example 		3 years ago
mass_s3 owner id is not what I expected -- switched to displayname for now 4 years ago
README.md Add example 3 years ago

README.md

mass_s3

Tool for running an operation on a bunch of objects in an S3 bucket a little more efficiently than some shit-fix bash scripts.

The tool will list and filter the objects in a single thread then fork a handful of processes to make the actual calls to the AWS API.

Installation

Pre-requisites

  • click
  • boto3

Usage

put-object-acl

mass_s3 put-object-acl [-m modified_since] [-o owner] <bucket> <path> <new_acl>
  • -m modified_since: Specify a date as YYYY-MM-DD, only objects modified on or after this date will be updated.
  • -o owner: Specify an owning account name, only objects owned by this account will be updated.
  • bucket: The S3 bucket to work on
  • path: A path prefix to match objects against
  • new_acl: The new acl set set on the matched objects. The Amazon canned ACLs are: private, public-read, public-read-write, authenticated-read, aws-exec-read, bucket-owner-read, bucket-owner-full-control

Example

mass_s3 put-object-acl -m 2020-03-01 -o other-account-alias my-files 2020/ bucket-owner-full-control