Regenerate video thumbnails

[mdc773]

[mdc773]

This post is deleted!

[robi]

Btw, it's "object storage".

It's an interesting failure scenario that should be investigated with the peertube guys upstream.

Perhaps they need better retries and resilience on their s3 backend code and options for not saving locally if that fails.

[mdc773]

thanks will do
and yeah lol object storage

[jdaviescoates]

@mdc773 said in Regenerate video thumbnails:

so what happen is peertube save the videos locally and its about 1.5TB then it takes up all the space and the app stops..... this the seconded time this happened so idk if the problem is idrive or cloudron

I was having similar problems with large videos when I was trying to run PeerTube on a server that didn't really have enough RAM / CPU to power it. Since I've been on a more powerful server everything has been working fine. I'd guess you're hitting a similar problem and what you need is a server upgrade.

[jdaviescoates]

@robi said in Regenerate video thumbnails:

options for not saving locally if that fails

I'm not sure, but I'd guess it does all the CPU intensive transcoding locally before uploading to S3.

[mdc773]

I appreciate everyone help even @jdaviescoates but hey i'm not 100% sure but i have a EX101 hetzner Intel Core i9-13900 24 Core with 128gb ram cant be the server peertube fails and i need to find the exact log.. at the moment i plan to simulate the problem with a massive upload :?

[jdaviescoates]

@mdc773 certainly sounds like server power is not the issue!

Just to be sure though, have you also cranked up the app resources in the app settings?

[girish]

Maybe I missed it, what is the error message now?

[mdc773]

well i am trying to simulate this at the moment..

[mdc773]

@jdaviescoates yes i have

[mdc773]

warn[10/24/2023, 3:39:37 PM] Object storage max upload part seems to have a big value (1073741824 bytes). Consider using a lower one (like 100MB). 

I have set this up long time ago i don't fully understand max upload part but I've set to 100MB like it says same problem peertube support is very slow they have a matrix chat but barley reply

i really need some help my idea for object storage was to save local space which i think this why all of us do this

[girish]

@mdc773 said in Regenerate video thumbnails:

i don't fully understand max upload part

On S3 compatible storage, you can upload large files, like 5TB. It would be infeasible to upload such large files in a single shot. So, they have APIs to upload files in "parts". Like you upload 10k parts of 5GB each for example to get to 5TB. The number of parts and size of each part depends on the S3 storage.

Usually, I leave upload part size to something like 10MB-50MB. There is actually nothing wrong with 100MB part size, but for some reason peertube is complaining about it.