Simplifying AWS S3 File Upload and Download on Ubuntu 22.04

by

Amazon Web Services (AWS) provides a robust and scalable cloud storage service known as Amazon Simple Storage Service (S3). With S3, you can store, organize, and retrieve any amount of data from anywhere on the web. Whether you are a developer, a data analyst, or just someone who wants to store files securely in the cloud, knowing how to upload and download files using AWS S3 is essential. In this blog post, we will guide you through the necessary steps to upload and download files to and from S3 using the command line on Ubuntu 22.04.

Prerequisites

Before we jump into the commands, here are a few prerequisites:

  1. AWS Account: Make sure you have an AWS account. If you don’t have one, you can sign up for free here.
  2. AWS CLI: The AWS Command Line Interface (CLI) is a tool that allows you to interact with AWS services from the command line. If you don’t have it installed on your Ubuntu machine, you can do so by following these steps: 
    sudo apt update
sudo apt install awscli
  3. AWS Configuration: After installing the AWS CLI, you need to configure it using your AWS credentials. You can obtain your Access Key ID and Secret Access Key from the AWS Management Console under “My Security Credentials.”Run the following command and input your credentials: 
    aws configure

    You will be prompted to provide:

    • AWS Access Key ID
    • AWS Secret Access Key
    • Default region name (e.g., us-east-1)
    • Default output format (e.g., json or text)

    After completing the setup, your AWS CLI is ready to use!

Uploading Files to S3

To upload files to your S3 bucket, you can use the aws s3 cp command. Below is the syntax and an example.

Syntax:

aws s3 cp [local_file_path] s3://[bucket_name]/[object_key]

Example:

Suppose you want to upload a file named example.txt from your home directory to an S3 bucket named mybucket, you can run:

aws s3 cp ~/example.txt s3://mybucket/

If you want to upload a folder and all its content, you can use the --recursive flag:

aws s3 cp ~/myfolder s3://mybucket/myfolder --recursive

Checking the Upload

To confirm that your file has been uploaded successfully, you can list the content of your S3 bucket:

aws s3 ls s3://mybucket/

Downloading Files from S3

Like uploading, downloading files is straightforward using the AWS CLI. Again, we will use the aws s3 cp command.

Syntax:

aws s3 cp s3://[bucket_name]/[object_key] [local_file_path]

Example:

To download the example.txt file from your S3 bucket mybucket to your home directory, you would run:

aws s3 cp s3://mybucket/example.txt ~/

If you need to download an entire folder, use the --recursive flag:

aws s3 cp s3://mybucket/myfolder ~/myfolder --recursive

Verifying the Download

To certainly check that your file has been downloaded, you can list the content of your directory:

ls ~/

Conclusion

Using AWS S3 for file management is a convenient way to access and store your data securely in the cloud. With just a few commands in the terminal on Ubuntu 22.04, you can easily upload and download files to and from your S3 buckets.

By following the steps outlined in this blog post, you can quickly get started with AWS S3 using the CLI. As you become more familiar with the AWS CLI, consider exploring additional commands and features to enhance your cloud experience. Happy uploading and downloading!

For more information and advanced configurations, refer to the AWS S3 documentation.

Leave a Comment