You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have a bucket where a huge amount of files (over 1Tb in about of 250000 objects) sorted among several subfolders. When I'm trying to sync every subfolder in particular it goes ok. It takes about 10-15 minutes to get subfolder sync report in --dry-run, but every time when I'm trying to check all subfolder i.e. sync the whole bucket s3cmd crash with an error ERROR: [Errno 111] Connection refused
The text was updated successfully, but these errors were encountered:
Hi I believe you could be facing either: rate limiting (too many connections in a short time) or simple network errors (again because too many connections open in a short time).
I would suggest you try to sync each sub-folder one after another, or create more levels with more sub-sub-folders and sync each one, possibly with a quick sleep 1 between to prevent rate limiting.
I have a bucket where a huge amount of files (over 1Tb in about of 250000 objects) sorted among several subfolders. When I'm trying to sync every subfolder in particular it goes ok. It takes about 10-15 minutes to get subfolder sync report in --dry-run, but every time when I'm trying to check all subfolder i.e. sync the whole bucket s3cmd crash with an error ERROR: [Errno 111] Connection refused
The text was updated successfully, but these errors were encountered: