Peertube and S3/Minio Objectstorage
-
# Store all videos in one bucket on Scaleway object_storage: enabled: true # Scaleway endpoint endpoint: 's3.fr-par.scw.cloud' region: 'fr-par' videos: bucket_name: 'bridport-tv' prefix: 'videos/' # Use the same bucket as for webtorrent videos but with a different prefix streaming_playlists: bucket_name: 'bridport-tv' prefix: 'streaming-playlists/' credentials: access_key_id: 'xxxxx' secret_access_key: 'xxxxx'That's was working fine for getting stuff into the bucket, but then videos didn't actually play
Bucket is also public:
@jdaviescoates if you get a public link, does it play in the browser?
compare that to the link the app tries to use?
-
@jdaviescoates if you get a public link, does it play in the browser?
compare that to the link the app tries to use?
@robi said in Peertube and S3/Minio Objectstorage:
@jdaviescoates if you get a public link, does it play in the browser?
Yes
-
@jdaviescoates if you get a public link, does it play in the browser?
compare that to the link the app tries to use?
@robi said in Peertube and S3/Minio Objectstorage:
compare that to the link the app tries to use?
Looking for that I spotted this:
CORS Missing Allowed OriginI guess that's likely the problem...
(man, it's SO much easier doing this stuff when I'm not both freezing cold and way too tired! /me reminds himself, again, to get more f-ing sleep and go to bed on f-ing time!)
-
@robi said in Peertube and S3/Minio Objectstorage:
compare that to the link the app tries to use?
Looking for that I spotted this:
CORS Missing Allowed OriginI guess that's likely the problem...
(man, it's SO much easier doing this stuff when I'm not both freezing cold and way too tired! /me reminds himself, again, to get more f-ing sleep and go to bed on f-ing time!)
Woohoo!
So, after following this guide:
https://www.scaleway.com/en/docs/storage/object/api-cli/object-storage-aws-cli/
And then this guide:
https://www.scaleway.com/en/docs/storage/object/api-cli/setting-cors-rules/
I now have videos stored on S3 that ALSO play!
-
Woohoo!
So, after following this guide:
https://www.scaleway.com/en/docs/storage/object/api-cli/object-storage-aws-cli/
And then this guide:
https://www.scaleway.com/en/docs/storage/object/api-cli/setting-cors-rules/
I now have videos stored on S3 that ALSO play!
Scaleway are great. Good prices, great docs!
I was tempted by special offer Contabo pricing, but unlike Scaleway they aren't 100% renewably powered (although their German based stuff when I'd bought some object storage is), and their docs are crap.
So looks like I'll just ditch Contabo and stick with using Scaleway for my Object Storage needs.
-
anyone done this on Linode?
-
I recently discovered how to host media from my Cloudron-hosted Mastodon instance on my Minio instance (non-Cloudron), and it works great. So I started exploring what else I can use my Minio storage for, and found a plugin for Wordpress, , that also works well. So now, I'm trying to see how to use it for Peertube, which apparently can use objectstorage. I've found the following links with sample yaml files, but I haven't been able to get it working on my own Cloudron-hosted Peertube instance. Has anyone else had success?
https://docs.joinpeertube.org/admin-remote-storage
https://framacolibri.org/t/redundancy-videos-not-able-to-use-object-storage/14668
https://github.com/Chocobozzz/PeerTube/blob/develop/config/production.yaml.example
https://github.com/Chocobozzz/PeerTube/blob/develop/support/docker/production/config/production.yaml
@scooke Thanks for asking this question. I might try this using block storage with Wasabi and PeerTube.
Why is object storage suitable for this task? Isn't object storage better for keeping gigantic files? I suppose a considerable archive of videos would end up needing a large amount of storage, but they would all be separate files.
-
@scooke Thanks for asking this question. I might try this using block storage with Wasabi and PeerTube.
Why is object storage suitable for this task? Isn't object storage better for keeping gigantic files? I suppose a considerable archive of videos would end up needing a large amount of storage, but they would all be separate files.
@LoudLemur said in Peertube and S3/Minio Objectstorage:
Why is object storage suitable for this task? Isn't object storage better for keeping gigantic files?
Video files are relatively large files.
But aside from that, often VPS servers don't come with much disk space and so Object Storage is just one relatively cheap way of increasing the amount of storage you have.
@LoudLemur said in Peertube and S3/Minio Objectstorage:
Wasabi
Lots of people on here seem to have moved away from them for various reasons.
The cheapest out there seems to be iDrive e2 who have a 90% off offer which makes it insanely cheap for the first year (and pretty good value after that):
Personally I use Scaleway who are also good value and 100% powered by renewable energy
I've got all my instances of Peertube, Mastodon, and Pixelfed all storing their data on Scaleway Object Storage.
-
@LoudLemur said in Peertube and S3/Minio Objectstorage:
Why is object storage suitable for this task? Isn't object storage better for keeping gigantic files?
Video files are relatively large files.
But aside from that, often VPS servers don't come with much disk space and so Object Storage is just one relatively cheap way of increasing the amount of storage you have.
@LoudLemur said in Peertube and S3/Minio Objectstorage:
Wasabi
Lots of people on here seem to have moved away from them for various reasons.
The cheapest out there seems to be iDrive e2 who have a 90% off offer which makes it insanely cheap for the first year (and pretty good value after that):
Personally I use Scaleway who are also good value and 100% powered by renewable energy
I've got all my instances of Peertube, Mastodon, and Pixelfed all storing their data on Scaleway Object Storage.
@jdaviescoates You are so good to me!
Thank you. I shall look into those. -
I'm wondering if there is a path to do this with Peertube + Hetzner storage box or if the S3 Storage objects way is the only way to store peertube video content outside the cloudron, anyone tried ?
edit : Hmm apparently, the answer is no, only S3 is supported : https://docs.joinpeertube.org/maintain/remote-storage#migrate-to-another-object-storage-provider
BenB
-
I'm wondering if there is a path to do this with Peertube + Hetzner storage box or if the S3 Storage objects way is the only way to store peertube video content outside the cloudron, anyone tried ?
edit : Hmm apparently, the answer is no, only S3 is supported : https://docs.joinpeertube.org/maintain/remote-storage#migrate-to-another-object-storage-provider
@benborges said in Peertube and S3/Minio Objectstorage:
I'm wondering if there is a path to do this with Peertube + Hetzner storage box or if the S3 Storage objects way is the only way to store peertube video content outside the cloudron, anyone tried ?
You might be able to mount a Volume and then use that for the data directory?
-
@benborges said in Peertube and S3/Minio Objectstorage:
I'm wondering if there is a path to do this with Peertube + Hetzner storage box or if the S3 Storage objects way is the only way to store peertube video content outside the cloudron, anyone tried ?
You might be able to mount a Volume and then use that for the data directory?
-
@benborges yeah, as it states in the data directory docs:
cifs and sshfs volumes are unsuitable as an app's data directory as they do not support file permissions and ownership. mountpoint and nfs volumes may or may not work depending on the destination filesystem.
