1.9 KiB
1.9 KiB
S5CMD Reference Guide
s5cmd is a fast and efficient S3 and local filesystem command-line tool optimized for large-scale data operations.
Command Syntax
s5cmd [global options] <command> [command options] [arguments...]
Global Options
| Option | Description |
|---|---|
--aws-profile string |
AWS profile to use |
--endpoint-url string |
Custom S3 endpoint |
--no-sign-request |
Do not sign requests (for public buckets) |
--numworkers int |
Number of parallel workers (default: 256) |
--retry-count int |
Number of retries for failed requests |
--json |
Output logs in JSON format |
--log string |
Log level: info, warning, error, debug |
--dry-run |
Show operations without executing |
Common Commands
List Buckets/Objects
s5cmd ls s3://bucket_2/
Bucket Management
s5cmd mb s3://new-bucket # Create bucket
s5cmd rb s3://bucket-name # Remove bucket
Upload Files
s5cmd cp local.txt s3://bucket/file.txt
Download Files
s5cmd cp s3://bucket/file.txt ./local.txt
s5cmd cp s3://bucket/*.jpg ./photos/
Move/Rename Files
s5cmd mv s3://bucket/old.txt s3://bucket/new.txt
Remove Files
s5cmd rm s3://bucket/file.txt
s5cmd rm --all-versions s3://bucket/file.txt
Synchronization
s5cmd sync ./localdir/ s3://bucket/targetdir/
s5cmd sync s3://bucket/targetdir/ ./localdir/
Read File Content
s5cmd cat s3://bucket/file.txt
Disk Usage
s5cmd du s3://bucket/*
Query with S3 Select
s5cmd select "select * from s3object s limit 10" s3://bucket/data.csv