It's easy these Days to create a Ticket an issue blame whatsoever.
What we always forget is I Guess to SAY Thank YOU

Thank you Clodron Team for being AWESOME.
And thank you to have Cloudron for Free!
You are doing great work and Progress: +1:

Have been using WireGuard since 2 Years now it is really fast, it would be great to see it in Cloudron maybe with PiHole.

Hi,
i just wannted to ask about the Firewall in Cloudron Whitelist and Blocklisting IP's.
Usually i would do it over UFW but since its a bit diffrent in Cloudron.
Because i see some IP's thanks to shodan -.- trying to send some spams and i would like to block them.
And GEO IP Blocking as a feature would be nice, i think login to my.cloudron.com should be really high secured, i mean yes we have 2FA but if someone tries bruteforce attacks will not lead to something because of 2FA, but why create uneeded webservice requests.

looking really forward for PI-Hole and Wireguard really

@Mallewax i think this would lead also to new people using cloudron

yeah i mean it would be for me i would never create pihole acessable for others its for private reasons vpn+pihole. So pihole would be listening, lets say on 10.9.0.0

Maybe in the future the idea could to configure other apps only availaie in the same VPN Network

@girish OK we will see the Result tomorrow br

Hi thanks for the Information any news or goals regarding firewall and security of Cloudron IP-Blocking or Fail2Ban maybe?

Are there any news Regarding Wireguard and Pihole in Cloudron?

@girish Sad to hear thath Pi-hole didn't workout but lets see how AdGuard is Thanks for your Work

@girish Yes it is a PI and i am always updates, i guess this is since the last minio update.
Sorry i dont have another vps

@nebulon I got the newest version and it looks like the issues is by uploading multiple files with gives a 500 back.

Version:2021-03-26T00:00:41Z
Version: go1.16.2 | CPUs: 4

@nebulon any clue on thath idk what it means sorry

minio log:

API: PutObjectPart(bucket=mybucket, object=myapp/snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839.tar.gz.enc)
Time: 00:20:11 UTC 03/30/2021
DeploymentID: d5aab97f-1878-40a6-a688-edf3b50b4960
RequestID: 1670F6C994C249CD
RemoteHost: 2.56.98.236
UserAgent: aws-sdk-nodejs/2.850.0 linux/v14.15.4 callback
Error: open /home/pi/data/.minio.sys/multipart/57fac6043320d82c0dc8e5332bbf92a93d28feab70e7de8bfaf6a3ea333d99aa/d279db31-dc24-4d74-959a-eb592d7915e0/fs.json: operation not permitted (*fs.PathError)
4: cmd/api-errors.go:2009:cmd.toAPIErrorCode()
3: cmd/api-errors.go:2034:cmd.toAPIError()
2: cmd/object-handlers.go:2272:cmd.objectAPIHandlers.PutObjectPartHandler()
1: net/http/server.go:2069:http.HandlerFunc.ServeHTTP()

@nebulon Got the Issues now 4 times a Row it got 1TB free i will check the logs

@savity And intressting is i got data uploaded on my minio

Its not all my data because it should be around 50GB

Snapshot:

Hi Cloudron Team
since the last Update i having issues with backuping my apps to my Minio.
Pleas find the Backup Logs from cloudron

2021-03-30T00:03:48.564Z box:shell backup-snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839 (stdout): 2021-03-30T00:03:48.560Z box:storage/s3 Error uploading [myapplication/snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839.tar.gz.enc]: s3 upload error. Error [InternalError]: We encountered an internal error, please try again.: cause(open /home/pi/data/.minio.sys/multipart/57fac6043320d82c0dc8e5332bbf92a93d28feab70e7de8bfaf6a3ea333d99aa/74f2a374-0090-44b8-8126-1f35d785abb7/fs.json: operation not permitted)
at Request.extractError (/home/yellowtent/box/node_modules/aws-sdk/lib/services/s3.js:700:35)
at Request.callListeners (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:106:20)
at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:78:10)
at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:688:14)
at Request.transition (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:22:10)
at AcceptorStateMachine.runTo (/home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:14:12)
at /home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:26:10
at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:38:9)
at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:690:12)
at Request.callListeners (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:116:18) {
code: 'InternalError',
region: null,
time: 2021-03-30T00:03:48.551Z,
requestId: '1670F5E49FD42D85',
extendedRequestId: undefined,
cfId: undefined,
statusCode: 500,
retryable: true
}

2021-03-30T00:11:38.029Z box:shell backup-snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839 (stdout): 2021-03-30T00:11:38.028Z box:backupupload v8 heap : used 49054720 total: 88043520 max: 4076863488

2021-03-30T00:11:38.837Z box:tasks 3379: {"percent":51,"message":"Uploading backup 4867M@7MBps (myapplication.mydomain.com)"}
2021-03-30T00:11:48.839Z box:tasks 3379: {"percent":51,"message":"Uploading backup 4956M@7MBps (myapplication.mydomain.com)"}
2021-03-30T00:11:53.230Z box:shell backup-snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839 (stdout): 2021-03-30T00:11:53.228Z box:storage/s3 Error uploading [myapplication/snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839.tar.gz.enc]: s3 upload error. Error [InternalError]: We encountered an internal error, please try again.: cause(open /home/pi/data/.minio.sys/multipart/57fac6043320d82c0dc8e5332bbf92a93d28feab70e7de8bfaf6a3ea333d99aa/00ed00d6-0f64-4e24-b894-227bf502c053/fs.json: operation not permitted)
at Request.extractError (/home/yellowtent/box/node_modules/aws-sdk/lib/services/s3.js:700:35)
at Request.callListeners (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:106:20)
at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:78:10)
at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:688:14)
at Request.transition (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:22:10)
at AcceptorStateMachine.runTo (/home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:14:12)
at /home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:26:10
at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:38:9)
at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:690:12)
at Request.callListeners (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:116:18) {
code: 'InternalError',
region: null,
time: 2021-03-30T00:11:53.216Z,
requestId: '1670F65577EB59C2',
extendedRequestId: undefined,
cfId: undefined,
statusCode: 500,
retryable: true
}

2021-03-30T00:20:11.937Z box:backups runBackupUpload: result - {"result":"Error uploading myapplication/snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839.tar.gz.enc. Message: We encountered an internal error, please try again.: cause(open /home/pi/data/.minio.sys/multipart/57fac6043320d82c0dc8e5332bbf92a93d28feab70e7de8bfaf6a3ea333d99aa/d279db31-dc24-4d74-959a-eb592d7915e0/fs.json: operation not permitted) HTTP Code: InternalError"}
2021-03-30T00:20:12.008Z box:shell backup-snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839 code: 50, signal: null
2021-03-30T00:20:12.010Z box:backups myapplication.mydomain.com Unable to backup BoxError: Error uploading myapplication/snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839.tar.gz.enc. Message: We encountered an internal error, please try again.: cause(open /home/pi/data/.minio.sys/multipart/57fac6043320d82c0dc8e5332bbf92a93d28feab70e7de8bfaf6a3ea333d99aa/d279db31-dc24-4d74-959a-eb592d7915e0/fs.json: operation not permitted) HTTP Code: InternalError
at /home/yellowtent/box/src/backups.js:897:29
at f (/home/yellowtent/box/node_modules/once/once.js:25:25)
at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:69:9)
at ChildProcess.emit (events.js:315:20)
at ChildProcess.EventEmitter.emit (domain.js:467:12)
at Process.ChildProcess._handle.onexit (internal/child_process.js:277:12) {
reason: 'External Error',
details: {}
}
2021-03-30T00:20:12.011Z box:taskworker Task took 1211.065 seconds
2021-03-30T00:20:12.011Z box:tasks setCompleted - 3379: {"result":null,"error":{"stack":"BoxError: Error uploading myapplication/snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839.tar.gz.enc. Message: We encountered an internal error, please try again.: cause(open /home/pi/data/.minio.sys/multipart/57fac6043320d82c0dc8e5332bbf92a93d28feab70e7de8bfaf6a3ea333d99aa/d279db31-dc24-4d74-959a-eb592d7915e0/fs.json: operation not permitted) HTTP Code: InternalError\n at /home/yellowtent/box/src/backups.js:897:29\n at f (/home/yellowtent/box/node_modules/once/once.js:25:25)\n at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:69:9)\n at ChildProcess.emit (events.js:315:20)\n at ChildProcess.EventEmitter.emit (domain.js:467:12)\n at Process.ChildProcess._handle.onexit (internal/child_process.js:277:12)","name":"BoxError","reason":"External Error","details":{},"message":"Error uploading myapplication/snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839.tar.gz.enc. Message: We encountered an internal error, please try again.: cause(open /home/pi/data/.minio.sys/multipart/57fac6043320d82c0dc8e5332bbf92a93d28feab70e7de8bfaf6a3ea333d99aa/d279db31-dc24-4d74-959a-eb592d7915e0/fs.json: operation not permitted) HTTP Code: InternalError"}}
2021-03-30T00:20:12.011Z box:tasks 3379: {"percent":100,"result":null,"error":{"stack":"BoxError: Error uploading myapplication/snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839.tar.gz.enc. Message: We encountered an internal error, please try again.: cause(open /home/pi/data/.minio.sys/multipart/57fac6043320d82c0dc8e5332bbf92a93d28feab70e7de8bfaf6a3ea333d99aa/d279db31-dc24-4d74-959a-eb592d7915e0/fs.json: operation not permitted) HTTP Code: InternalError\n at /home/yellowtent/box/src/backups.js:897:29\n at f (/home/yellowtent/box/node_modules/once/once.js:25:25)\n at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:69:9)\n at ChildProcess.emit (events.js:315:20)\n at ChildProcess.EventEmitter.emit (domain.js:467:12)\n at Process.ChildProcess._handle.onexit (internal/child_process.js:277:12)","name":"BoxError","reason":"External Error","details":{},"message":"Error uploading myapplication/snapshot/app_5b67e84d-40da-4604-80ec-45e8d610c839.tar.gz.enc. Message: We encountered an internal error, please try again.: cause(open /home/pi/data/.minio.sys/multipart/57fac6043320d82c0dc8e5332bbf92a93d28feab70e7de8bfaf6a3ea333d99aa/d279db31-dc24-4d74-959a-eb592d7915e0/fs.json: operation not permitted) HTTP Code: InternalError"}

It's easy these Days to create a Ticket an issue blame whatsoever.
What we always forget is I Guess to SAY Thank YOU

Thank you Clodron Team for being AWESOME.
And thank you to have Cloudron for Free!
You are doing great work and Progress: +1:

@girish It didn't worked for 4 Days now in a row

@girish and some time a go you have given me a soluton:

@savity Can you try this change https://git.cloudron.io/cloudron/box/-/commit/bedcd6fccf58830b316318699375bc1f582a5d7a ? The file on Cloudron is /home/yellowtent/box/src/storage/s3.js. Essentially change the timeout from 3000 * 1000 to 0. And also change maxRetries to 10. You don't need to restart anything after the change since the code changes are immediately picked up.

I am using MINIO as Backup and i think this all started after the last Ubuntu security update

@girish there was really no error but since theni raised the backup RAM and it worked for 1 Week.

Now i got a new error

Jan 19 02:11:14 box:tasks 2859: {"percent":51,"message":"Uploading backup 4473M@7MBps (SERVER.domain.domain)"}
Jan 19 02:11:20 box:shell backup-snapshot/APP_ID (stdout): 2021-01-19T01:11:20.928Z box:storage/s3 Error uploading [SERVER/snapshot/APP_ID.tar.gz.enc]: s3 upload error. { InternalError: We encountered an internal error, please try again.
at Request.extractError (/home/yellowtent/box/node_modules/aws-sdk/lib/services/s3.js:837:35)
at Request.callListeners (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:106:20)
at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:78:10)
at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:688:14)
at Request.transition (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:22:10)
at AcceptorStateMachine.runTo (/home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:14:12)
at /home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:26:10
at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:38:9)
at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:690:12)
at Request.callListeners (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:116:18)
message: 'We encountered an internal error, please try again.',
code: 'InternalError',
region: null,
time: 2021-01-19T01:11:20.924Z,
requestId: '165B7CF26E4F51D8',
extendedRequestId: undefined,
cfId: undefined,
statusCode: 500,
retryable: true }
Jan 19 02:11:20 box:shell backup-snapshot/APP_ID (stdout): 2021-01-19T01:11:20.929Z box:backupupload upload completed. error: { BoxError: Error uploading SERVER/snapshot/APP_ID.tar.gz.enc. Message: We encountered an internal error, please try again. HTTP Code: InternalError
at ManagedUpload.callback (/home/yellowtent/box/src/storage/s3.js:130:33)
at ManagedUpload.cleanup (/home/yellowtent/box/node_modules/aws-sdk/lib/s3/managed_upload.js:629:10)
at Response.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/s3/managed_upload.js:566:28)
at Request.<anonymous> (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:369:18)
at Request.callListeners (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:106:20)
at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/sequential_executor.js:78:10)
at Request.emit (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:688:14)
at Request.transition (/home/yellowtent/box/node_modules/aws-sdk/lib/request.js:22:10)
at AcceptorStateMachine.runTo (/home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:14:12)
at /home/yellowtent/box/node_modules/aws-sdk/lib/state_machine.js:26:10
name: 'BoxError',
reason: 'External Error',
details: {},
message:
'Error uploading SERVER/snapshot/APP_ID.tar.gz.enc. Message: We encountered an internal error, please try again. HTTP Code: InternalError' }
Jan 19 02:11:20 box:backups runBackupUpload: result - {"result":"Error uploading SERVER/snapshot/APP_ID.tar.gz.enc. Message: We encountered an internal error, please try again. HTTP Code: InternalError"}
Jan 19 02:11:21 box:shell backup-snapshot/APP_ID code: 50, signal: null
Jan 19 02:11:21 box:backups SERVER.domain.domain Unable to backup { BoxError: Error uploading SERVER/snapshot/APP_ID.tar.gz.enc. Message: We encountered an internal error, please try again. HTTP Code: InternalError
at /home/yellowtent/box/src/backups.js:874:29
at f (/home/yellowtent/box/node_modules/once/once.js:25:25)
at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:69:9)
at ChildProcess.emit (events.js:198:13)
at ChildProcess.EventEmitter.emit (domain.js:448:20)
at Process.ChildProcess._handle.onexit (internal/child_process.js:248:12)
name: 'BoxError',
reason: 'External Error',
details: {},
message:
'Error uploading SERVER/snapshot/APP_ID.tar.gz.enc. Message: We encountered an internal error, please try again. HTTP Code: InternalError' }
Jan 19 02:11:21 box:taskworker Task took 680.211 seconds
Jan 19 02:11:21 box:tasks setCompleted - 2859: {"result":null,"error":{"stack":"BoxError: Error uploading SERVER/snapshot/APP_ID.tar.gz.enc. Message: We encountered an internal error, please try again. HTTP Code: InternalError\n at /home/yellowtent/box/src/backups.js:874:29\n at f (/home/yellowtent/box/node_modules/once/once.js:25:25)\n at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:69:9)\n at ChildProcess.emit (events.js:198:13)\n at ChildProcess.EventEmitter.emit (domain.js:448:20)\n at Process.ChildProcess._handle.onexit (internal/child_process.js:248:12)","name":"BoxError","reason":"External Error","details":{},"message":"Error uploading SERVER/snapshot/APP_ID.tar.gz.enc. Message: We encountered an internal error, please try again. HTTP Code: InternalError"}}
Jan 19 02:11:21 box:tasks 2859: {"percent":100,"result":null,"error":{"stack":"BoxError: Error uploading SERVER/snapshot/APP_ID.tar.gz.enc. Message: We encountered an internal error, please try again. HTTP Code: InternalError\n at /home/yellowtent/box/src/backups.js:874:29\n at f (/home/yellowtent/box/node_modules/once/once.js:25:25)\n at ChildProcess.<anonymous> (/home/yellowtent/box/src/shell.js:69:9)\n at ChildProcess.emit (events.js:198:13)\n at ChildProcess.EventEmitter.emit (domain.js:448:20)\n at Process.ChildProcess._handle.onexit (internal/child_process.js:248:12)","name":"BoxError","reason":"External Error","details":{},"message":"Error uploading SERVER/snapshot/APP_ID.tar.gz.enc. Message: We encountered an internal error, please try again. HTTP Code: InternalError"}}