Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

Cloudron Forum

Apps | Demo | Docs | Install

Backup feedback over sshfs

Scheduled Pinned Locked Moved Solved Support
sshfsbackups
35 Posts 6 Posters 1.3k Views
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • H Offline
    H Offline
    hendrikvl
    wrote on last edited by
    #17

    I use a Hetzner storagebox via sshfs as backup provider and also have the issue with the volume being not mounted after reach reboot. Clicking the remount volume button solves it for me though. All previous backups are correctly listed after remounting.

    Having to remount the volume manually is somewhat annoying though and I would appreciate a solution which solves the issue with the circular dependency on boot.

    1 Reply Last reply
    1
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    replied to rmdes on last edited by
    #18

    @rmdes actually I am not sure if you use that thing correctly. Volumes and the backup storage are not really related. The way you have it configured, the same mountpoint would be mounted twice. Once for the volume (which is supposed to be used within apps) and the backup storage.

    @hendrikvl we try to fix this reboot and volume mounting issue in the upcoming release.

    rmdesR 2 Replies Last reply
    0
  • rmdesR Offline
    rmdesR Offline
    rmdes
    replied to nebulon on last edited by rmdes
    #19

    @nebulon wow, alright, I may have misunderstood the documentation then, will remove on the volume side

    • now I remember, I had it on the volume because one of my apps/domains was reading a music folder from the same sshfs mount point, which happened to be the same storage.
    rmdesR 1 Reply Last reply
    0
  • rmdesR Offline
    rmdesR Offline
    rmdes
    replied to rmdes on last edited by
    #20

    So that must be why after a remount (wihtout removing the volume or backup mount)
    the newly mounted volume cannot "see" the pre-existing files ?
    a7737c96-190e-4b6f-a5f8-c70932057f77-image.png

    1 Reply Last reply
    0
  • rmdesR Offline
    rmdesR Offline
    rmdes
    replied to nebulon on last edited by
    #21

    @nebulon So this is the steps I did :

    • removed the volume since no app was using it
    • remounted the backup by clicking "remount storage" on the backup view

    All seems to be ready for a backup but old backups are gone :
    0cf883e3-196b-4bb7-a436-075e5dec18c3-image.png

    nebulonN 1 Reply Last reply
    0
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    replied to rmdes on last edited by
    #22

    @rmdes can you check on the server if /mnt/cloudronbackup is actually mounted or not? seems to be some discrepancy here.

    Further, if you change the backup storage configuration, previous backups will be removed from the listing, since a new backup storage may have different mechanisms to access them and Cloudron only ever stores one storage configuration. Note that the backup meta info is stored in the database, so even if the files would be on that disk, Cloudron does not look around the disk and tries to find existing backups...maybe it should, but it doesn't currently.

    rmdesR 1 Reply Last reply
    0
  • rmdesR Offline
    rmdesR Offline
    rmdes
    replied to nebulon on last edited by rmdes
    #23

    @nebulon it is mounted, I can list all the backups just fine, it would be really neat to have cloudron reading some kind of index that could be generated after each backup keeping the backup directory tree index safe, even in between mounts ?

    • it's totally fine and normal that if backup type is changed that it looses the index, but here it's not the case, nothing was changed, the machine was rebooted and lost the backup mount, I manually remounted it, but all the previous backups are not listed, even tho it's the same backup config.
      I created a new backup now and had to remove all the previous backups manually to make sure I have something I can use if I need to restore an app without crippling my backup storage with untied backups that I can only retrieve manually.

    • A bonus I noticed by having my backup storage mounted a second time (not the case anymore) in the Volumes view is that I could via the file explorer manage my backups with the cloudron file explorer, pretty handy to delete unneeded parts or to manage a non backup folder for music etc..

    rmdesR 1 Reply Last reply
    0
  • rmdesR Offline
    rmdesR Offline
    rmdes
    replied to rmdes on last edited by
    #24

    I really wish there was a "scan existing backup" feature, because each time I have to remount, previous backups are gone from the UI

    nebulonN 1 Reply Last reply
    0
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    replied to rmdes on last edited by
    #25

    @rmdes maybe there is something else wrong, since a remount alone should not touch the backup listing as such. Only a reconfiguration of the backup config would invalidate the backup listing.

    rmdesR 1 Reply Last reply
    0
  • rmdesR Offline
    rmdesR Offline
    rmdes
    replied to nebulon on last edited by
    #26

    @nebulon Maybe but I have no idea what can it be..
    if I LS /mnt/cloudronbackup from the box everything is there
    I will try to list /mnt/cloudronbackup next time the box reboot, before remounting in the UI and see what's up..

    • one question : does cloudron backup write an index somewhere inside the mounted backup ?
    nebulonN 1 Reply Last reply
    0
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    replied to rmdes on last edited by
    #27

    @rmdes as mentioned, the existence of the files on the backup storage is not related to the listing of backups in the dashboard. The latter is based on the meta information stored in the database (so that is kind of the index you asked for), Cloudron will not try to scan and identify potential backups. Even if it did, it would be quite hard to automatically ensure those are correct and complete. So I think, since we are talking about backup storage, our current strategy to invalidate the listing, once the storage is adjusted is ok. Anyways the storage should not be changed frequently.

    I think though, since we have solved the reboot and mount issue with upcoming release. The manual remount will not be required. Although I do not understand why the backup listing will be cleared out if you just remount, I can't spot any code which might do that.

    rmdesR 1 Reply Last reply
    1
  • rmdesR Offline
    rmdesR Offline
    rmdes
    replied to nebulon on last edited by
    #28

    @nebulon alright, thanks for the explanation, will report feedback with the upcoming new version, indeed, if the mount problem is gone, no need to touch the backup config 🙂

    rmdesR 1 Reply Last reply
    0
  • rmdesR Offline
    rmdesR Offline
    rmdes
    replied to rmdes on last edited by
    #29

    Good news ! even tho the reboot-mount bug is still there, since the last upgrade Backups keep being listed even if the mount point is lost or unmounted.

    56761074-bb9d-416d-bc8d-4a5c3ad40146-image.png

    rmdesR 1 Reply Last reply
    1
  • rmdesR Offline
    rmdesR Offline
    rmdes
    replied to rmdes on last edited by
    #30

    I got the entire bug all over again after reboot, lost mountpoint and lost index of backups, not sure what I can do to provide more context/log ?

    0c9b0d8a-4310-4e10-aa40-7757ba6a54e4-image.png

    nebulonN 1 Reply Last reply
    0
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    replied to rmdes on last edited by
    #31

    @rmdes did you click the remount storage button or submitted the configure dialog for backup storage, given that the indicator is green on the top?

    rmdesR 1 Reply Last reply
    0
  • rmdesR Offline
    rmdesR Offline
    rmdes
    replied to nebulon on last edited by
    #32

    @nebulon Correct, should have done the screenshot before remounting it,
    but the state the cloudron rebooted was no backup index and sshfs unmounted.

    avatar1024A 1 Reply Last reply
    0
  • avatar1024A Offline
    avatar1024A Offline
    avatar1024
    replied to rmdes on last edited by
    #33

    @rmdes @nebulon Just to add to this. I was in touch with @girish through support, reporting a similar issue of the backup listing getting cleared if the storage is not mounted while the automated job of cleaning up the listing is run (the listing gets cleaned regularly to get rid of stale backup entries in the listing). I believe they are trying to find a solution to this.

    I proposed that either the automated cleaning job should first check that the backup location is accessible before cleaning up the entries in the db (preferred solution), or that the listing should not get cleaned automatically but only if triggered manually by pressing the "Cleanup Backup" button, in which case the user can ensure the volume is mounted before doing it (but this is less preferred as there is still a risk of deleting the entries by errors).

    girishG 1 Reply Last reply
    1
  • girishG Offline
    girishG Offline
    girish Staff
    replied to avatar1024 on last edited by girish
    #34

    @avatar1024 Yes, thanks for the feedback. I am working though a fix now. For a start, the backup cleaner logic is not checking the mount status before cleaning up. I think if I fix that atleast the backup db entries won't disappear erroneously.

    edit: to be clear, I am implementing your "I proposed that either the automated cleaning job should first check that the backup location is accessible before cleaning up the entries in the db" solution.

    avatar1024A 1 Reply Last reply
    3
  • avatar1024A Offline
    avatar1024A Offline
    avatar1024
    replied to girish on last edited by
    #35

    @girish Sounds great, thanks Girish.

    1 Reply Last reply
    0

  • Login

  • Don't have an account? Register

  • Login or register to search.
  • First post
    Last post
0
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Login

  • Don't have an account? Register

  • Login or register to search.