Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Search
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

Cloudron Forum

Apps | Demo | Docs | Install
  1. Cloudron Forum
  2. Support
  3. Help with Wasabi mounting

Help with Wasabi mounting

Scheduled Pinned Locked Moved Solved Support
rclonewasabifuse
68 Posts 6 Posters 25.4k Views 5 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • robiR robi

    @privsec Avoid manually typing it in, as it is very error prone. Sometimes the keys have 'Il' and you can't tell which is the L and which is the i.

    P Offline
    P Offline
    privsec
    wrote on last edited by
    #11

    @robi I disabled ssh, and am using my VPS "ssh" console.

    Tbh, I dont know how to re-enable root user
    I ran this https://github.com/akcryptoguy/vps-harden and ever since I cant get ssh to work. So I am forced to do it all by hand

    robiR 1 Reply Last reply
    0
    • P privsec

      @robi I disabled ssh, and am using my VPS "ssh" console.

      Tbh, I dont know how to re-enable root user
      I ran this https://github.com/akcryptoguy/vps-harden and ever since I cant get ssh to work. So I am forced to do it all by hand

      robiR Offline
      robiR Offline
      robi
      wrote on last edited by
      #12

      @privsec you likely edit /etc/ssh/sshd_config

      Conscious tech

      P 1 Reply Last reply
      0
      • robiR robi

        @privsec you likely edit /etc/ssh/sshd_config

        P Offline
        P Offline
        privsec
        wrote on last edited by
        #13

        @robi Thank you.

        I have access again for easier troubleshooting and I ended up reinstalling the OS and everything and once it all came back up I was able to add mounts.

        Though its odd. I changed my data directory for nextcloud to /mnt/volumes/nextcloud and not all content is there.

        Like if I click files manager it takes me to what Id assume is the cloud drive from wasabi, but there are files there that are not in wasabi

        In addition, when I try to view the logs for any application OR for cloudron itself I am getting ee6f1400-8924-43ad-98ca-3bab9abdbb07-image.png

        P 1 Reply Last reply
        0
        • P privsec

          @robi Thank you.

          I have access again for easier troubleshooting and I ended up reinstalling the OS and everything and once it all came back up I was able to add mounts.

          Though its odd. I changed my data directory for nextcloud to /mnt/volumes/nextcloud and not all content is there.

          Like if I click files manager it takes me to what Id assume is the cloud drive from wasabi, but there are files there that are not in wasabi

          In addition, when I try to view the logs for any application OR for cloudron itself I am getting ee6f1400-8924-43ad-98ca-3bab9abdbb07-image.png

          P Offline
          P Offline
          privsec
          wrote on last edited by
          #14

          @privsec As an example
          01371ac8-c5db-4530-a93f-6d8798caa582-image.png That is on my server via CLI

          And this
          e9682bf9-4fe9-4657-b854-703916363d15-image.png That is within the nextcloud bucket for my app.

          P 1 Reply Last reply
          0
          • P privsec

            @privsec As an example
            01371ac8-c5db-4530-a93f-6d8798caa582-image.png That is on my server via CLI

            And this
            e9682bf9-4fe9-4657-b854-703916363d15-image.png That is within the nextcloud bucket for my app.

            P Offline
            P Offline
            privsec
            wrote on last edited by
            #15

            I am uploading 7.23 gigs worth of files and will report back. On my VPS server the SSD had 131.59gb free out of 156gb 7440764f-4d67-4972-a1e2-f0658419bc0d-image.png

            When the uploads finish, Ill report back.

            1 Reply Last reply
            0
            • P Offline
              P Offline
              privsec
              wrote on last edited by
              #16

              So, I confirmed its saving data to the ssd of the VPS rather than sending it to the cloud
              64bb7b75-c0f4-42f4-beab-8dec1ec73ab8-image.png

              The uploads are not complete yet, but its evident that they are being stored locally rather then in the cloud.

              Below is my Nexcloud app storage setting. Nexcloud is the actual rclone mounted folder.

              07f3ebd8-786f-47c4-a0f5-d425cecfa1ab-image.png

              Am I doing something wrong?

              girishG 1 Reply Last reply
              0
              • P privsec

                So, I confirmed its saving data to the ssd of the VPS rather than sending it to the cloud
                64bb7b75-c0f4-42f4-beab-8dec1ec73ab8-image.png

                The uploads are not complete yet, but its evident that they are being stored locally rather then in the cloud.

                Below is my Nexcloud app storage setting. Nexcloud is the actual rclone mounted folder.

                07f3ebd8-786f-47c4-a0f5-d425cecfa1ab-image.png

                Am I doing something wrong?

                girishG Offline
                girishG Offline
                girish
                Staff
                wrote on last edited by
                #17

                @privsec Did I understand correctly that /mnt/volumes/nextcloud is an rclone wasabi mount and you have also moved the app data directory of nextcloud to this location ? If so, what you have done seems correct. I don't know about the correctness of rclone itself nor do I know about how rclone mounting really works. Does the mount show up in df -h output ?

                You say there is a discrepancy between what's the in the filesystem and what's in wasabi, so this looks like some rclone issue?

                P 2 Replies Last reply
                0
                • robiR Offline
                  robiR Offline
                  robi
                  wrote on last edited by
                  #18

                  can you paste the output of:

                  df -h

                  mount

                  How did you set up rclone? (OS pkg, latest, beta)
                  Is rclone still running?

                  What version is it?

                  Conscious tech

                  1 Reply Last reply
                  0
                  • girishG girish

                    @privsec Did I understand correctly that /mnt/volumes/nextcloud is an rclone wasabi mount and you have also moved the app data directory of nextcloud to this location ? If so, what you have done seems correct. I don't know about the correctness of rclone itself nor do I know about how rclone mounting really works. Does the mount show up in df -h output ?

                    You say there is a discrepancy between what's the in the filesystem and what's in wasabi, so this looks like some rclone issue?

                    P Offline
                    P Offline
                    privsec
                    wrote on last edited by
                    #19

                    @girish It might be an rclone issue

                    @robi
                    I installed Rclone by following these steps https://rclone.org/install/

                    1. curl https://rclone.org/install.sh | sudo bash
                    2. rclone config
                      3 rclone mount remote:path /path/to/mountpoint --vfs-cache-mode full --daemon

                    df -h

                    root@v2202012134940134654:~# df -h
                    Filesystem      Size  Used Avail Use% Mounted on
                    udev            3.9G     0  3.9G   0% /dev
                    tmpfs           798M   11M  788M   2% /run
                    /dev/sda3       157G   25G  126G  17% /
                    tmpfs           3.9G     0  3.9G   0% /dev/shm
                    tmpfs           5.0M     0  5.0M   0% /run/lock
                    tmpfs           3.9G     0  3.9G   0% /sys/fs/cgroup
                    /dev/sda2       976M  146M  764M  17% /boot
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/5e80dc05d8a594a5a0c51aa5602ca124b428e0edba09181759e184497e45a875/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/903a9ff390459afb42b38eaa6b07c0f30f4f45fa413e154e35f766d3bcec7893/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/6af811d56e81cce0af9c14fcb1f0eadb6466a4a4eaa6bfd750eed95d5207c688/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/fbdaaedecbb9dbeeb0212e3dadb0cb32697ad523af7cbaf713a25bd567536edb/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/0c70992b7b8b2c704fc0a080263eb8eb09ae8518fc7054518ce58b75b4ad7e0d/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/f0d4d24114f30306a670e596a11d42b5fde57d30cee607746760dba613331055/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/ed4fd11e18c018a69bde9307d18a20f7380621126baf20e6de96949cb2a0cb19/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/c03dea8bf938e7044b8f9eb746dfbdcce955e69534c2c6a82b86c22c5aaaca5c/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/2eb8958e2598de5291a0895da411df947b97a6f873022b5eab415b6b2f8678b6/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/57f8ec7cc792bcc8e7f8c6a3a24c89cc2ef74bfcf794423a422d75aec0825144/merged
                    tmpfs           798M     0  798M   0% /run/user/0
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/acd1b16c14ff94c587d697ff2a57c1c52df183d034ac7a7067f6a6b251a88977/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/c65f5aa0b3af3f75055a43b3a8d529b0a3fd51d23806538e4c5b8d2173ac4489/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/299711c86c910f26718ad9670963b511d86726d61cb67716d1f8566dbd83addd/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/043dea9ba03986e56e9fbd7f3760faf2dd4538db77839be209c049e74648a0be/merged
                    overlay         157G   25G  126G  17% /var/lib/docker/overlay2/0d3609e2d1f83f95df827fce2598eb713edf161e1a8bf0a01045621e1061ad95/merged
                    
                    girishG 1 Reply Last reply
                    0
                    • P privsec

                      @girish It might be an rclone issue

                      @robi
                      I installed Rclone by following these steps https://rclone.org/install/

                      1. curl https://rclone.org/install.sh | sudo bash
                      2. rclone config
                        3 rclone mount remote:path /path/to/mountpoint --vfs-cache-mode full --daemon

                      df -h

                      root@v2202012134940134654:~# df -h
                      Filesystem      Size  Used Avail Use% Mounted on
                      udev            3.9G     0  3.9G   0% /dev
                      tmpfs           798M   11M  788M   2% /run
                      /dev/sda3       157G   25G  126G  17% /
                      tmpfs           3.9G     0  3.9G   0% /dev/shm
                      tmpfs           5.0M     0  5.0M   0% /run/lock
                      tmpfs           3.9G     0  3.9G   0% /sys/fs/cgroup
                      /dev/sda2       976M  146M  764M  17% /boot
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/5e80dc05d8a594a5a0c51aa5602ca124b428e0edba09181759e184497e45a875/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/903a9ff390459afb42b38eaa6b07c0f30f4f45fa413e154e35f766d3bcec7893/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/6af811d56e81cce0af9c14fcb1f0eadb6466a4a4eaa6bfd750eed95d5207c688/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/fbdaaedecbb9dbeeb0212e3dadb0cb32697ad523af7cbaf713a25bd567536edb/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/0c70992b7b8b2c704fc0a080263eb8eb09ae8518fc7054518ce58b75b4ad7e0d/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/f0d4d24114f30306a670e596a11d42b5fde57d30cee607746760dba613331055/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/ed4fd11e18c018a69bde9307d18a20f7380621126baf20e6de96949cb2a0cb19/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/c03dea8bf938e7044b8f9eb746dfbdcce955e69534c2c6a82b86c22c5aaaca5c/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/2eb8958e2598de5291a0895da411df947b97a6f873022b5eab415b6b2f8678b6/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/57f8ec7cc792bcc8e7f8c6a3a24c89cc2ef74bfcf794423a422d75aec0825144/merged
                      tmpfs           798M     0  798M   0% /run/user/0
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/acd1b16c14ff94c587d697ff2a57c1c52df183d034ac7a7067f6a6b251a88977/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/c65f5aa0b3af3f75055a43b3a8d529b0a3fd51d23806538e4c5b8d2173ac4489/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/299711c86c910f26718ad9670963b511d86726d61cb67716d1f8566dbd83addd/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/043dea9ba03986e56e9fbd7f3760faf2dd4538db77839be209c049e74648a0be/merged
                      overlay         157G   25G  126G  17% /var/lib/docker/overlay2/0d3609e2d1f83f95df827fce2598eb713edf161e1a8bf0a01045621e1061ad95/merged
                      
                      girishG Offline
                      girishG Offline
                      girish
                      Staff
                      wrote on last edited by
                      #20

                      @privsec From a casual reading of rclone, it seems that it's a FUSE mount. Isn't the mount point supposed to appear in df -h output ? Also, see https://linoxide.com/linux-command/list-mounted-drives-on-linux/ . I think it's not mounted properly (I also don't know if this mount persists reboots, maybe you rebooted in the middle).

                      1 Reply Last reply
                      0
                      • girishG girish

                        @privsec Did I understand correctly that /mnt/volumes/nextcloud is an rclone wasabi mount and you have also moved the app data directory of nextcloud to this location ? If so, what you have done seems correct. I don't know about the correctness of rclone itself nor do I know about how rclone mounting really works. Does the mount show up in df -h output ?

                        You say there is a discrepancy between what's the in the filesystem and what's in wasabi, so this looks like some rclone issue?

                        P Offline
                        P Offline
                        privsec
                        wrote on last edited by
                        #21

                        @girish

                        My mount output was too large. So I have it in this .txt file

                        Mount.txt

                        In addition, it is still running and the version is here

                        root@v2202012134940134654:~# rclone --version
                        rclone v1.53.3

                        • os/arch: linux/amd64
                        • go version: go1.15.5
                        girishG 1 Reply Last reply
                        0
                        • P privsec

                          @girish

                          My mount output was too large. So I have it in this .txt file

                          Mount.txt

                          In addition, it is still running and the version is here

                          root@v2202012134940134654:~# rclone --version
                          rclone v1.53.3

                          • os/arch: linux/amd64
                          • go version: go1.15.5
                          girishG Offline
                          girishG Offline
                          girish
                          Staff
                          wrote on last edited by
                          #22

                          @privsec So, the df output says /dev/sda3 157G 25G 126G 17% /. Doesn't this mean, it's working as expected ? I think the Cloudron graphs are probably wrong because we haven't really accounted for this FUSE use case (since it doesn't appear in df output).

                          What we do is: get df output. Then substract away the du output size of each app. I think in your case, the app is in a FUSE mount, so the code will blindly subtract from the disk output and show wrong numbers.

                          P 1 Reply Last reply
                          0
                          • girishG girish

                            @privsec So, the df output says /dev/sda3 157G 25G 126G 17% /. Doesn't this mean, it's working as expected ? I think the Cloudron graphs are probably wrong because we haven't really accounted for this FUSE use case (since it doesn't appear in df output).

                            What we do is: get df output. Then substract away the du output size of each app. I think in your case, the app is in a FUSE mount, so the code will blindly subtract from the disk output and show wrong numbers.

                            P Offline
                            P Offline
                            privsec
                            wrote on last edited by
                            #23

                            @girish If that is the case then how come I see data in the mounted path, but not in the wasabi bucket?

                            In the data directory I see no files 8c767314-bc62-4b01-a119-e669969af10c-image.png

                            But via file manager c2cec72d-bf49-4587-85ea-6a934a1440de-image.png
                            I see these files f32df541-df4f-4fdc-85c2-126d6b94c4d8-image.png
                            But in wasabi I see d871f0b6-196a-4bb2-8f32-78dd40ff21b0-image.png

                            Something isnt right and I dont know what it is

                            girishG 1 Reply Last reply
                            0
                            • P privsec

                              @girish If that is the case then how come I see data in the mounted path, but not in the wasabi bucket?

                              In the data directory I see no files 8c767314-bc62-4b01-a119-e669969af10c-image.png

                              But via file manager c2cec72d-bf49-4587-85ea-6a934a1440de-image.png
                              I see these files f32df541-df4f-4fdc-85c2-126d6b94c4d8-image.png
                              But in wasabi I see d871f0b6-196a-4bb2-8f32-78dd40ff21b0-image.png

                              Something isnt right and I dont know what it is

                              girishG Offline
                              girishG Offline
                              girish
                              Staff
                              wrote on last edited by
                              #24

                              @privsec I remember the Backblaze B2 UI does not always show the latest items in the object store. Could it be similar with Wasabi? If you create a file in the filesystem, do you see it in wasabi immediately? One other idea is to install rclone in another machine and list the remote wasabi mount. What objects/files do you see?

                              P 1 Reply Last reply
                              0
                              • girishG girish

                                @privsec I remember the Backblaze B2 UI does not always show the latest items in the object store. Could it be similar with Wasabi? If you create a file in the filesystem, do you see it in wasabi immediately? One other idea is to install rclone in another machine and list the remote wasabi mount. What objects/files do you see?

                                P Offline
                                P Offline
                                privsec
                                wrote on last edited by
                                #25

                                @girish Nope, I added 7 giggs of files and nothing is in wasabi.

                                Do you mean set up a second instance of rclone on another machine, set up the remote there and see if rclone syncs the files with the 2nd machine?

                                Is there a better/different way to do a file mounting?

                                I only did rclone based off of @robi 's request/recommendation

                                girishG 1 Reply Last reply
                                0
                                • P privsec

                                  @girish Nope, I added 7 giggs of files and nothing is in wasabi.

                                  Do you mean set up a second instance of rclone on another machine, set up the remote there and see if rclone syncs the files with the 2nd machine?

                                  Is there a better/different way to do a file mounting?

                                  I only did rclone based off of @robi 's request/recommendation

                                  girishG Offline
                                  girishG Offline
                                  girish
                                  Staff
                                  wrote on last edited by
                                  #26

                                  @privsec You can try s3fs because wasabi even has an article about it - https://wasabi-support.zendesk.com/hc/en-us/articles/115001744651-How-do-I-use-S3FS-with-Wasabi- . Also, for a start, I would test the mount first without Cloudron involved at all, just to make sure it's not Cloudron related.

                                  1 Reply Last reply
                                  0
                                  • robiR Offline
                                    robiR Offline
                                    robi
                                    wrote on last edited by
                                    #27

                                    If we can't validate the rclone mount, don't continue with apps & Cloudron.

                                    Same for s3fs if you're going to try that again.

                                    The reason you see files locally but not remotely is because there's something wrong with the mount or it didn't work, hence all files written are only in a local directory.
                                    Remote is never getting data via the mount.

                                    Conscious tech

                                    P 1 Reply Last reply
                                    1
                                    • robiR robi

                                      If we can't validate the rclone mount, don't continue with apps & Cloudron.

                                      Same for s3fs if you're going to try that again.

                                      The reason you see files locally but not remotely is because there's something wrong with the mount or it didn't work, hence all files written are only in a local directory.
                                      Remote is never getting data via the mount.

                                      P Offline
                                      P Offline
                                      privsec
                                      wrote on last edited by
                                      #28

                                      @robi
                                      To be clear, are you saying to stop trying? Or are you saying to verify the mount on my Server OS first and then afterwords resume with cloudron?

                                      @girish

                                      I will test the mount outside of cloudron and then report back.

                                      In addition, I will try out s3fs again and try to get that to work for me.

                                      robiR 1 Reply Last reply
                                      0
                                      • P privsec

                                        @robi
                                        To be clear, are you saying to stop trying? Or are you saying to verify the mount on my Server OS first and then afterwords resume with cloudron?

                                        @girish

                                        I will test the mount outside of cloudron and then report back.

                                        In addition, I will try out s3fs again and try to get that to work for me.

                                        robiR Offline
                                        robiR Offline
                                        robi
                                        wrote on last edited by
                                        #29

                                        @privsec the latter.

                                        verify the mount on my Server OS first and then afterwords resume with cloudron

                                        Conscious tech

                                        P 1 Reply Last reply
                                        1
                                        • robiR robi

                                          @privsec the latter.

                                          verify the mount on my Server OS first and then afterwords resume with cloudron

                                          P Offline
                                          P Offline
                                          privsec
                                          wrote on last edited by privsec
                                          #30

                                          @robi @girish
                                          Ok, noob alert

                                          Other then running rclone lsd remote:bucket and rclone ls wasabi:nextcloud.myprivsec. I do not know how to test rclones connection.

                                          I just created an empty text file called "hello.txt" via touch hello.txt in the mounted folder on my server, and it did not get sent to wasabi.

                                          So then that means that the connection is not working right?

                                          Could this be do to unmounting after a reboot? I believe one occurred after setting the mount up. How do i get this to persist through reboots?

                                          I am going to try out the s3fs once more right now and will report back on that.

                                          robiR 1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • Bookmarks
                                          • Search