How to Download to an S3 Bucket

How to Download to an S3 Bucket

The following article will cover the process for downloading material to an S3 bucket. Some pre-contextual information needed for this process is that upon uploading to S3 the item is stored as an S3 object, you can have an unlimited number of objects in a bucket; but before doing so you will need to set permissions for the bucket.

The steps required for downloading to an S3 bucket are:
  1. Sign into the AWS Management Console and left-click on S3
  2. Within the resulting window select the name of the created bucket 

  3. After navigating into the desired S3 bucket the left-click on the upload button this will allow you to either upload multiple files or a folder (to be noted that you are able to drag and drop into this window)
  4. If desired object properties can be configured before upload using additional upload options
  5. Modify the Access Control List (ACL) permissions found underneath the Permissions tab
  6. If Metadata should be added left click on the Add Metadata button
  7. After inserting the metadata click upload to finish the process
This process can also be scripted in python with boto3 as follows:
  1. import boto3
  2. from botocore.exceptions import NoCredentialsError
  3. ACCESS_KEY = 'XXXXXXXXXXXXXXXXXXXXXXX'
  4. SECRET_KEY = 'XXXXXXXXXXXXXXXXXXXXXXX'
  5. def upload_to_aws(local_file, bucket, s3_file):
    1. s3 = boto3.client('s3', aws_access_key_id= ACCESS_KEY, aws_secret_access_key = SECRET_KEY)
    2. try:
      1. s3.upload_file(local_file, bucket, s3_file)
      2. print("Upload Successful")
      3. return True
    3. except FileNotFoundError:
      1. print("The file was not found")
      2. return False
    4. except NoCredentialsError:
      1. print("Credentials not available")
      2. return False
  6. uploaded = upload_to_aws('local_file', 'bucket_name', 's3_file_name')