Trying to add an sshfs mounted location as a regular file system volume type in Cloudron

[djxx]

I'm facing the same issue with Nextcloud and trying to tune the performance of SSHFS (https://forum.cloudron.io/topic/13852/sshfs-read-speed-significantly-slower-than-scp-with-the-same-target/9) . The answer, at least for Nextcloud, is to adjust the configuration file. Instead of trying to "trick" Cloudron into accepting an SSHFS mount point as the primary storage, just adjust the applications config file to point to the mount point. Not sure if it will work for Immich, but it works for Nextcloud.

Also, I'm doing this with Nextcloud for the exact same reason - I want to manage my pictures. I'm trying the "Memories" plugin in Nextcloud which has prettty good reviews. I'll probably move on to Immich next for testing.

[makemrproper]

Sounds like the case is identical, yes :).

Great workaround! I will try it.

Solving it at the hypervisor level is not any better than directly on the cloudron vm. There is no way to share a folder to a vm. Only nfs, cifs, sshfs or direct block device.

The reason is that our phones are growing, and at current I need to sync 5x family members phones at 1tb. Not insane anounts of course, but way beyond the m2.ssd cloudron is running on.

[robi]

@makemrproper said in Trying to add an sshfs mounted location as a regular file system volume type in Cloudron:

or direct block device

https://linbit.com/drbd/ is the gold standard.

[andreasdueren]

@makemrproper I'm sorry could you summarize or even give step-by-step instructions on what you ended up doing?

[joseph]

@makemrproper said in Trying to add an sshfs mounted location as a regular file system volume type in Cloudron:

When trying to I am trying to add the /mnt/folder to Cloudron as a filesystem volume type, I am getting this error: hostPath must be a realpath without symlinks

Just tested this and this works fine here. Is /mnt/folder a symlink? I have a fstab line to mount a sshfs into /mnt/folder . And then I just added Filesystem mount type in Volumes view.

[msbt]

Also getting that message, but on a different use-case. I'm trying to add a (sftp) rclone mount to Cloudron. Mounting and browsing works fine, but when trying to add it as a volume, it says hostPath must be a realpath without symlinks. Is that not supported?

[joseph]

Didn't get an answer to my earlier question. Is it a symlink? You can't add symlinks.

Can you try node -e "fs.realpathSync('/the/path')" ? This function is failing or returning something other than the path you are adding for some reason.

[msbt]

Can only speak for my issue, not a symlink:

/mnt# ls -la
total 12
drwxr-xr-x  4 root root 4096 Jun  9 09:21 .
drwxr-xr-x 23 root root 4096 Dec 17 11:10 ..
drwxr-xr-x  1 root root    0 Jun  9 09:22 media
drwxr-xr-x  2 root root 4096 Dec 17 11:31 volumes

Your command doesn't fail, but doesn't give any output either.

[joseph]

@msbt said in Trying to add an sshfs mounted location as a regular file system volume type in Cloudron:

Your command doesn't fail, but doesn't give any output either.

My bad... Can you try like this:

root@my:/mnt# node -e "console.log(fs.realpathSync('/mnt/folder'))"
/mnt/folder

[msbt]

@joseph sure:

/mnt# node -e "console.log(fs.realpathSync('/mnt/media'))"
/mnt/media

[joseph]

@msbt you are trying to add /mnt/media in the Volumes view ? I cannot see why https://git.cloudron.io/platform/box/-/blob/master/src/volumes.js?ref_type=heads#L57 will fail . That's where the error message comes from. If you are ok debugging a bit, just put some console.log in that function and systemctl restart box.

[msbt]

@joseph happy to, can you maybe enable chat so we can do that 1:1?

[joseph]

@msbt can you instead write to me at support@cloudron.io please? Will debug it right away.

[msbt]

My issue is resolved, adding a --allow-other parameter to the mount solved it, thanks @girish and @joseph

[andreasdueren]

@msbt I'm sorry but could you do a small writeup of your setup? I'd be interested in using a storage box as storage backend.

[msbt]

@andreasdueren the setup in this case is based on rclone, is that what you're looking for? Because the regular storage box setup you probably already know of, since you posted in there as well https://forum.cloudron.io/post/32783

[andreasdueren]

@msbt Yes the regular storage box setup i'm well familiar with. But that won't work with immich. So you installed rclone and connected via the SFTP backend?

[msbt]

@andreasdueren yep, I did this to install and configure it:

curl https://rclone.org/install.sh | sudo bash
rclone config

after that, the config will resides in

~/.config/rclone/rclone.conf

and will look something like this (I enabled encryption too, because why not :

[backup]
type = sftp
host = u123456-sub1.your-storagebox.de
user = u123456-sub1
port = 23
pass = hashed_pwd
md5sum_command = md5 -r
sha1sum_command = sha1 -r
shell_type = unix
idle_timeout = 0

[backupcrypt]
type = crypt
remote = backup:backup

mounting:

mkdir /mnt/backup
chown -R yellowtent:yellowtent /mnt/backup
rclone mount backupcrypt: /mnt/backup \
    --crypt-password "verylonghashedpwd" \
    --crypt-password2 "evenlongerhashedpwd" \
    --vfs-cache-mode writes --daemon --transfers 3 --checkers 6 --allow-other

The last bit was the important one, without it mounting wasn't possible. You should now be able to mount the rclone thing as a volume. For whatever reason it shows the red dot, I'm guessing that's because of the fs. However, I haven't had an issue with that in months. Currently I'm mounting it manually on every machine reboot, but there are ways to mount it automatically.

[andreasdueren]

@msbt nice, thanks! Will have to read out on that. How is speed? Are you using it for immich?

[msbt]

@andreasdueren you're welcome, I forgot to post the Hetzner docs, they also have a bit of information on that. Speeds are fine, never had any issues with various kinds of media.