Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Search
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

Cloudron Forum

Apps | Demo | Docs | Install
  1. Cloudron Forum
  2. Pixelfed
  3. Profile images doesnt load on S3

Profile images doesnt load on S3

Scheduled Pinned Locked Moved Unsolved Pixelfed
22 Posts 6 Posters 3.3k Views 7 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • jdaviescoatesJ jdaviescoates

      @nebulon said in Profile images dosnt load on S3:

      Once upstream makes a new release with the fix, we will update the package of course.

      I'm confused though, because that fix was committed back in July 2022 and is tagged Pixelfed 0.11.4 which is also what we're running on Cloudron, so I'm unclear why Profile pics with S3 enabled aren't working?

      jdaviescoatesJ Offline
      jdaviescoatesJ Offline
      jdaviescoates
      wrote on last edited by jdaviescoates
      #8

      Aha looking at the link for the avatar image, I see it's like this:

      https://bridport.picshttps//bridport-pics.s3.fr-par.scw.cloud/public/avatars/052/274/889/869/491/404/9/3KE8LIMTBRbT8dlgbysN_avatar.png?v=3

      If I take of off the superflous https://bridport.pics at the beginning it works fine:

      https://bridport-pics.s3.fr-par.scw.cloud/public/avatars/052/274/889/869/491/404/9/3KE8LIMTBRbT8dlgbysN_avatar.png?v=3

      So I wonder how/ why that extra bit is coming from...

      I can see this in the logs:

      Jan 22 13:59:19 [2023-01-22 13:59:18] production.ERROR: Image source not readable {"exception":"[object] (Intervention\\Image\\Exception\\NotReadableException(code: 0): Image source not readable at /app/code/vendor/intervention/image/src/Intervention/Image/AbstractDecoder.php:351)
      

      So I don't know if this is a bug or if I've got something wrong in my config?

      I use Cloudron with Gandi & Hetzner

      jdaviescoatesJ 1 Reply Last reply
      0
      • jdaviescoatesJ jdaviescoates

        Aha looking at the link for the avatar image, I see it's like this:

        https://bridport.picshttps//bridport-pics.s3.fr-par.scw.cloud/public/avatars/052/274/889/869/491/404/9/3KE8LIMTBRbT8dlgbysN_avatar.png?v=3

        If I take of off the superflous https://bridport.pics at the beginning it works fine:

        https://bridport-pics.s3.fr-par.scw.cloud/public/avatars/052/274/889/869/491/404/9/3KE8LIMTBRbT8dlgbysN_avatar.png?v=3

        So I wonder how/ why that extra bit is coming from...

        I can see this in the logs:

        Jan 22 13:59:19 [2023-01-22 13:59:18] production.ERROR: Image source not readable {"exception":"[object] (Intervention\\Image\\Exception\\NotReadableException(code: 0): Image source not readable at /app/code/vendor/intervention/image/src/Intervention/Image/AbstractDecoder.php:351)
        

        So I don't know if this is a bug or if I've got something wrong in my config?

        jdaviescoatesJ Offline
        jdaviescoatesJ Offline
        jdaviescoates
        wrote on last edited by
        #9

        @jdaviescoates said in Profile images dosnt load on S3:

        So I don't know if this is a bug or if I've got something wrong in my config?

        Reading this https://github.com/pixelfed/pixelfed/issues/4041

        It sounds like you have to have FILESYSTEM_DRIVE=local for the Avatars to work. So I tried that.

        But now it seems all files are getting stored twice, once locally and then again in the Object Storage.

        See e.g. https://bridport.pics/i/web/post/522792891553329155

        Really I only want to store thing in the object storage, not locally at all. But I've got MEDIA_DELETE_LOCAL_AFTER_CLOUD=true so maybe eventually it will delete the local versions? 🤷

        Yep, it seems that perhaps files are just being cached locally, because if I open the Web Terminal and run php artisan cache:clear then right-click Open image in new tab it opens the S3 version (although as you can see in the post linked to above, for now the local version still seems to exist too... presumably eventually that'll get deleted, ah but then again perhaps not as per https://github.com/pixelfed/pixelfed/issues/3845#issuecomment-1331691661 ).

        I use Cloudron with Gandi & Hetzner

        jdaviescoatesJ 1 Reply Last reply
        0
        • jdaviescoatesJ jdaviescoates

          @jdaviescoates said in Profile images dosnt load on S3:

          So I don't know if this is a bug or if I've got something wrong in my config?

          Reading this https://github.com/pixelfed/pixelfed/issues/4041

          It sounds like you have to have FILESYSTEM_DRIVE=local for the Avatars to work. So I tried that.

          But now it seems all files are getting stored twice, once locally and then again in the Object Storage.

          See e.g. https://bridport.pics/i/web/post/522792891553329155

          Really I only want to store thing in the object storage, not locally at all. But I've got MEDIA_DELETE_LOCAL_AFTER_CLOUD=true so maybe eventually it will delete the local versions? 🤷

          Yep, it seems that perhaps files are just being cached locally, because if I open the Web Terminal and run php artisan cache:clear then right-click Open image in new tab it opens the S3 version (although as you can see in the post linked to above, for now the local version still seems to exist too... presumably eventually that'll get deleted, ah but then again perhaps not as per https://github.com/pixelfed/pixelfed/issues/3845#issuecomment-1331691661 ).

          jdaviescoatesJ Offline
          jdaviescoatesJ Offline
          jdaviescoates
          wrote on last edited by
          #10

          @jdaviescoates said in Profile images dosnt load on S3:

          presumably eventually that'll get deleted, ah but then again perhaps not as per https://github.com/pixelfed/pixelfed/issues/3845#issuecomment-1331691661 ).

          I've filed an issue about this:

          https://github.com/pixelfed/pixelfed/issues/4114

          I've also confirmed that manually deleting images from the local storage via the File Manager does not break posts.

          I use Cloudron with Gandi & Hetzner

          doodlemania2D 1 Reply Last reply
          1
          • jdaviescoatesJ jdaviescoates

            @jdaviescoates said in Profile images dosnt load on S3:

            presumably eventually that'll get deleted, ah but then again perhaps not as per https://github.com/pixelfed/pixelfed/issues/3845#issuecomment-1331691661 ).

            I've filed an issue about this:

            https://github.com/pixelfed/pixelfed/issues/4114

            I've also confirmed that manually deleting images from the local storage via the File Manager does not break posts.

            doodlemania2D Offline
            doodlemania2D Offline
            doodlemania2
            App Dev
            wrote on last edited by
            #11

            @jdaviescoates similar impact on the latest build since we switched to dev branch! cc: @girish FYI only. Hope they get that bug fixed 😉

            jdaviescoatesJ 2 Replies Last reply
            1
            • doodlemania2D doodlemania2

              @jdaviescoates similar impact on the latest build since we switched to dev branch! cc: @girish FYI only. Hope they get that bug fixed 😉

              jdaviescoatesJ Offline
              jdaviescoatesJ Offline
              jdaviescoates
              wrote on last edited by jdaviescoates
              #12

              @doodlemania2 yeah, it seems at present if you want profile images/ avatars to work you HAVE to have FILESYSTEM_DRIVER=local but then all your media is store BOTH locally AND on S3. Odd.

              The obvious solution would seem to me to be to simply make avatars/ profile images work when FILESYSTEM_DRIVER=s3 too, then all would be fine and dandy imho.

              I use Cloudron with Gandi & Hetzner

              doodlemania2D 1 Reply Last reply
              0
              • jdaviescoatesJ jdaviescoates

                @doodlemania2 yeah, it seems at present if you want profile images/ avatars to work you HAVE to have FILESYSTEM_DRIVER=local but then all your media is store BOTH locally AND on S3. Odd.

                The obvious solution would seem to me to be to simply make avatars/ profile images work when FILESYSTEM_DRIVER=s3 too, then all would be fine and dandy imho.

                doodlemania2D Offline
                doodlemania2D Offline
                doodlemania2
                App Dev
                wrote on last edited by
                #13

                @jdaviescoates yep - it's a bit of an odd situation. and blocking me from going live 😞

                jdaviescoatesJ 1 Reply Last reply
                0
                • doodlemania2D doodlemania2

                  @jdaviescoates similar impact on the latest build since we switched to dev branch! cc: @girish FYI only. Hope they get that bug fixed 😉

                  jdaviescoatesJ Offline
                  jdaviescoatesJ Offline
                  jdaviescoates
                  wrote on last edited by
                  #14

                  @doodlemania2 said in Profile images dosnt load on S3:

                  Hope they get that bug fixed

                  Like it to help them pay attention to is? 😉

                  I use Cloudron with Gandi & Hetzner

                  1 Reply Last reply
                  0
                  • doodlemania2D doodlemania2

                    @jdaviescoates yep - it's a bit of an odd situation. and blocking me from going live 😞

                    jdaviescoatesJ Offline
                    jdaviescoatesJ Offline
                    jdaviescoates
                    wrote on last edited by
                    #15

                    @doodlemania2 said in Profile images dosnt load on S3:

                    @jdaviescoates yep - it's a bit of an odd situation. and blocking me from going live 😞

                    I'm not expecting to be swamped with users and so I've decided to go live with having everything store twice for now because I've a fair bit of unused disk space right now. If I end up getting a load of active users then I may need to manually start deleting stuff from local storage until this is fixed, but hopefully it'll be fixed before then!

                    I use Cloudron with Gandi & Hetzner

                    doodlemania2D 1 Reply Last reply
                    0
                    • jdaviescoatesJ jdaviescoates

                      @doodlemania2 said in Profile images dosnt load on S3:

                      @jdaviescoates yep - it's a bit of an odd situation. and blocking me from going live 😞

                      I'm not expecting to be swamped with users and so I've decided to go live with having everything store twice for now because I've a fair bit of unused disk space right now. If I end up getting a load of active users then I may need to manually start deleting stuff from local storage until this is fixed, but hopefully it'll be fixed before then!

                      doodlemania2D Offline
                      doodlemania2D Offline
                      doodlemania2
                      App Dev
                      wrote on last edited by
                      #16

                      @jdaviescoates I'm stuck on the URL still being munged with half local and half s3 with the profile pic...

                      jdaviescoatesJ 1 Reply Last reply
                      0
                      • doodlemania2D doodlemania2

                        @jdaviescoates I'm stuck on the URL still being munged with half local and half s3 with the profile pic...

                        jdaviescoatesJ Offline
                        jdaviescoatesJ Offline
                        jdaviescoates
                        wrote on last edited by
                        #17

                        @doodlemania2 said in Profile images doesnt load on S3:

                        @jdaviescoates I'm stuck on the URL still being munged with half local and half s3 with the profile pic...

                        Ah, I think removing/ commenting out AWS_URL might fix that.

                        Can't remember exactly but I had it and then later after doing something, I didn't.

                        I think perhaps it was that, or it that plus changing FILESYSTEM_DRIVER from s3 to local.

                        I use Cloudron with Gandi & Hetzner

                        doodlemania2D 1 Reply Last reply
                        1
                        • jdaviescoatesJ jdaviescoates

                          @doodlemania2 said in Profile images doesnt load on S3:

                          @jdaviescoates I'm stuck on the URL still being munged with half local and half s3 with the profile pic...

                          Ah, I think removing/ commenting out AWS_URL might fix that.

                          Can't remember exactly but I had it and then later after doing something, I didn't.

                          I think perhaps it was that, or it that plus changing FILESYSTEM_DRIVER from s3 to local.

                          doodlemania2D Offline
                          doodlemania2D Offline
                          doodlemania2
                          App Dev
                          wrote on last edited by
                          #18

                          @jdaviescoates filesystem to local did it!

                          1 Reply Last reply
                          2
                          • A Offline
                            A Offline
                            alwynispat
                            wrote on last edited by
                            #19

                            Another weird thing about the app is that if you upload from web, it's serving the image from the Server even though both locations has it.
                            if you upload from the app, it'll serve from s3.

                            then when you run php artisan cache:clear it'll get fixed.

                            Wonder if it'll auto switch to s3 without touching.

                            Since it's storing images on both locations, will it like auto delete from server?

                            Find me at Mastodon

                            jdaviescoatesJ 1 Reply Last reply
                            0
                            • A alwynispat

                              Another weird thing about the app is that if you upload from web, it's serving the image from the Server even though both locations has it.
                              if you upload from the app, it'll serve from s3.

                              then when you run php artisan cache:clear it'll get fixed.

                              Wonder if it'll auto switch to s3 without touching.

                              Since it's storing images on both locations, will it like auto delete from server?

                              jdaviescoatesJ Offline
                              jdaviescoatesJ Offline
                              jdaviescoates
                              wrote on last edited by
                              #20

                              @alwynispat said in Profile images doesnt load on S3:

                              Wonder if it'll auto switch to s3 without touching.
                              Since it's storing images on both locations, will it like auto delete from server?

                              I think it's supposed to do that after 12 hours or something , but I've not checked properly to see if that is indeed the case .

                              I use Cloudron with Gandi & Hetzner

                              1 Reply Last reply
                              1
                              • G Offline
                                G Offline
                                gh0stface
                                wrote on last edited by
                                #21

                                Hello, is there any update/guidance from the Cloudron team on this? As in the original topic posted- profile images not properly working if using S3 as storage?

                                Anyone else able to figure anything else out with the profile avatar and using S3 compatible storage?

                                If I'm understanding this correctly (and I could be wrong), this issue was addressed by this commit back in July 2022. And was bundled into the v0.11.4 release, which was made available in Oct 2022.

                                A 1 Reply Last reply
                                0
                                • G gh0stface

                                  Hello, is there any update/guidance from the Cloudron team on this? As in the original topic posted- profile images not properly working if using S3 as storage?

                                  Anyone else able to figure anything else out with the profile avatar and using S3 compatible storage?

                                  If I'm understanding this correctly (and I could be wrong), this issue was addressed by this commit back in July 2022. And was bundled into the v0.11.4 release, which was made available in Oct 2022.

                                  A Offline
                                  A Offline
                                  alwynispat
                                  wrote on last edited by
                                  #22

                                  @gh0stface so this is what I've setup;

                                  ## S3 Storage
                                  PF_ENABLE_CLOUD=true
                                  FILESYSTEM_DRIVER=local
                                  FILESYSTEM_CLOUD=s3
                                  PF_LOCAL_AVATAR_TO_CLOUD=true
                                  MEDIA_DELETE_LOCAL_AFTER_CLOUD=true
                                  AWS_ACCESS_KEY_ID=xxx
                                  AWS_SECRET_ACCESS_KEY=xxx
                                  AWS_DEFAULT_REGION=xxx
                                  AWS_BUCKET=mediapixelfedsg
                                  AWS_URL=https://media.pixelfed.sg
                                  AWS_ENDPOINT=https://xxx.backblazeb2.com
                                  #AWS_USE_PATH_STYLE_ENDPOINT=false
                                  

                                  and it works.

                                  Find me at Mastodon

                                  1 Reply Last reply
                                  2
                                  • nebulonN nebulon marked this topic as a question on
                                  Reply
                                  • Reply as topic
                                  Log in to reply
                                  • Oldest to Newest
                                  • Newest to Oldest
                                  • Most Votes


                                    • Login

                                    • Don't have an account? Register

                                    • Login or register to search.
                                    • First post
                                      Last post
                                    0
                                    • Categories
                                    • Recent
                                    • Tags
                                    • Popular
                                    • Bookmarks
                                    • Search