Backup failed, error "InvalidArgument InvalidArgument: Range specified is not valid for source object"

[d19dotca]

I noticed a backup failed last night, it's the first failure I've seen with this type of error, and the very next backup succeeded so I just wanted to inquire about this one. The last bit of the logs are below for reference. The main error portion seemed to be InvalidArgument InvalidArgument: Range specified is not valid for source object.

Jan 20 04:18:37box:tasks update 23477: {"percent":53.63157894736845,"message":"Copying with concurrency of 10"}
Jan 20 04:18:37box:tasks update 23477: {"percent":53.63157894736845,"message":"Copying files from 0-1"}
Jan 20 04:18:37box:tasks update 23477: {"percent":53.63157894736845,"message":"Copying (multipart) {CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc"}
Jan 20 04:18:40box:tasks update 23477: {"percent":53.63157894736845,"message":"Copying part 1 - /cloudron-backups/{CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc bytes=0-1073741823"}
Jan 20 04:18:40box:tasks update 23477: {"percent":53.63157894736845,"message":"Copying part 3 - /cloudron-backups/{CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc bytes=2147483648-3221225471"}
Jan 20 04:18:54box:tasks update 23477: {"percent":53.63157894736845,"message":"Copying part 3 - Etag: \"4e4b54bc08223e06623dd522542dddb4\""}
Jan 20 04:18:54box:tasks update 23477: {"percent":53.63157894736845,"message":"Copying part 4 - /cloudron-backups/{CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc bytes=3221225472-3909745923"}
Jan 20 04:18:54box:tasks update 23477: {"percent":53.63157894736845,"message":"Aborting multipart copy of {CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc"}
Jan 20 04:18:54box:tasks update 23477: {"percent":53.63157894736845,"message":"Retrying (1) multipart copy of {CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc. Error: InvalidArgument: Range specified is not valid for source object 400"}
Jan 20 04:18:54box:storage/s3 copy: s3 copy error when copying {CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc: InvalidArgument: Range specified is not valid for source object
Jan 20 04:18:54box:backuptask copy: copied to 2024-01-20-120001-496/app_{appHostname}_v3.4.0 errored. error: Error copying {CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc (3909745924 bytes): InvalidArgument InvalidArgument: Range specified is not valid for source object
Jan 20 04:18:54box:tasks update 23477: {"percent":53.63157894736845,"message":"Copied 1 files with error: BoxError: Error copying {CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc (3909745924 bytes): InvalidArgument InvalidArgument: Range specified is not valid for source object"}
Jan 20 04:18:54box:tasks setCompleted - 23477: {"result":null,"error":{"stack":"BoxError: Error copying {CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc (3909745924 bytes): InvalidArgument InvalidArgument: Range specified is not valid for source object\n at done (/home/yellowtent/box/src/storage/s3.js:338:48)\n at Response.<anonymous> (/home/yellowtent/box/src/storage/s3.js:414:71)\n at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:367:18)\n at Request.callListeners (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:106:20)\n at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:78:10)\n at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:686:14)\n at Request.transition (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:22:10)\n at AcceptorStateMachine.runTo (/home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:14:12)\n at /home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:26:10\n at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:38:9)","name":"BoxError","reason":"External Error","details":{},"message":"Error copying {CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc (3909745924 bytes): InvalidArgument InvalidArgument: Range specified is not valid for source object"}}
Jan 20 04:18:54box:taskworker Task took 1133.43 seconds
Jan 20 04:18:54box:tasks update 23477: {"percent":100,"result":null,"error":{"stack":"BoxError: Error copying {CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc (3909745924 bytes): InvalidArgument InvalidArgument: Range specified is not valid for source object\n at done (/home/yellowtent/box/src/storage/s3.js:338:48)\n at Response.<anonymous> (/home/yellowtent/box/src/storage/s3.js:414:71)\n at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:367:18)\n at Request.callListeners (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:106:20)\n at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:78:10)\n at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:686:14)\n at Request.transition (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:22:10)\n at AcceptorStateMachine.runTo (/home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:14:12)\n at /home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:26:10\n at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:38:9)","name":"BoxError","reason":"External Error","details":{},"message":"Error copying {CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc (3909745924 bytes): InvalidArgument InvalidArgument: Range specified is not valid for source object"}}
Error copying {CloudronHostname}/snapshot/app_6b3ebc4f-9708-4243-bc21-4c9a01bc3499.tar.gz.enc (3909745924 bytes): InvalidArgument InvalidArgument: Range specified is not valid for source object

[girish]

This is a error from the storage provider. If it happens repeatedly, we have to report to them that multi-part copies are failing.

[d19dotca]

Good to know, thanks Girish. It never happened again, only once so I guess it was transient in nature.