Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Search
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

Cloudron Forum

Apps | Demo | Docs | Install
  1. Cloudron Forum
  2. Discuss
  3. Why does refreshing Disk Usage take so long?

Why does refreshing Disk Usage take so long?

Scheduled Pinned Locked Moved Solved Discuss
disk usage
13 Posts 5 Posters 1.5k Views 5 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • nebulonN nebulon

    df -h is indeed fast, but that operates on a disk/partition level. We use that info. But for the drilled down disk usage we have to use du as well as docker commands, those take a long time and also cause extra disk I/O. This is the reason why this is updated only once a day or when manually triggered.

    If anyone has suggestions on how to get this info faster on the filesystem/inode level also, this would be great.

    robiR Offline
    robiR Offline
    robi
    wrote on last edited by
    #3

    @nebulon since all apps are a relatively known size as packaged the only changing variables are the stored app-data from localdisk and volume mounts.

    No need to keep recalculating static assets.

    Hence combining the known static data with the change data size from a du -sh for very specific app dirs would likely be faster.

    Conscious tech

    1 Reply Last reply
    0
    • nebulonN Offline
      nebulonN Offline
      nebulon
      Staff
      wrote on last edited by nebulon
      #4

      docker image sizes are fast to retrieve also, what takes time are the app data dirs, this depends very much on disk speed as well of course on the actual used space and amount of files. The du command is already only run for specific folders.

      1 Reply Last reply
      1
      • nebulonN nebulon

        df -h is indeed fast, but that operates on a disk/partition level. We use that info. But for the drilled down disk usage we have to use du as well as docker commands, those take a long time and also cause extra disk I/O. This is the reason why this is updated only once a day or when manually triggered.

        If anyone has suggestions on how to get this info faster on the filesystem/inode level also, this would be great.

        jdaviescoatesJ Offline
        jdaviescoatesJ Offline
        jdaviescoates
        wrote on last edited by jdaviescoates
        #5

        @nebulon ok, thanks. No big deal really, I was just wondering.

        In my case, what I actually wanted to see was if these mounted volumes had changed

        Screenshot from 2023-11-08 10-55-41.png

        Specifically the top one which is the Storage Box I do backups onto, which was getting rather full. So I changed the retention policy and did a backup cleanup, and I was just wanted to see if it had indeed freed up a load of space (It had, yay!).

        I wonder if perhaps those external drives/ volumes which don't have any app data could have their own little refresh buttons too? (presumably just refreshing those wouldn't take long at all given as there is no app data to go through?)

        I use Cloudron with Gandi & Hetzner

        1 Reply Last reply
        0
        • robiR Offline
          robiR Offline
          robi
          wrote on last edited by
          #6

          duc may be an option
          https://duc.zevv.nl/

          Conscious tech

          1 Reply Last reply
          0
          • robiR Offline
            robiR Offline
            robi
            wrote on last edited by robi
            #7

            From: https://unix.stackexchange.com/questions/3019/how-can-i-calculate-the-size-of-a-directory

            You can use "file-size.sh" from the awk Velour library:

            ls -ARgo "$@" | awk '{q += $3} END {print q}'

            Conscious tech

            1 Reply Last reply
            0
            • girishG Do not disturb
              girishG Do not disturb
              girish
              Staff
              wrote on last edited by
              #8

              Are you using a CIFS/Storage Box ? Doing a du -Dsb takes forever on those.

              jdaviescoatesJ 1 Reply Last reply
              0
              • girishG girish

                Are you using a CIFS/Storage Box ? Doing a du -Dsb takes forever on those.

                jdaviescoatesJ Offline
                jdaviescoatesJ Offline
                jdaviescoates
                wrote on last edited by
                #9

                @girish said in Why does refreshing Disk Usage take so long?:

                Are you using a CIFS/Storage Box ? Doing a du -Dsb takes forever on those.

                Yes, ah. So perhaps it's those that is taking forever anyway, and so adding little refresh buttons just for those probably wouldn't help too much. Ah well, nevermind. No biggie.

                I use Cloudron with Gandi & Hetzner

                1 Reply Last reply
                1
                • girishG girish has marked this topic as solved on
                • jdaviescoatesJ Offline
                  jdaviescoatesJ Offline
                  jdaviescoates
                  wrote on last edited by
                  #10

                  I was just wondering this again and nearly created the exact same topic! 😆

                  TBH it's mostly just the same results that df -h gives that I'm normally interested in (i.e. total disk usage). In this case because my backup Volume was getting full up due to so many large Nextcloud backs from lots of updates over the past week.

                  I'm less interested in what the specific apps are using (although that is interesting too, just rarely what I'm actually looking for)

                  Could the two be separated out somehow so that it's possible to just quickly get updated total df -h figures while waiting for all the detail?

                  I use Cloudron with Gandi & Hetzner

                  robiR 1 Reply Last reply
                  1
                  • jdaviescoatesJ jdaviescoates

                    I was just wondering this again and nearly created the exact same topic! 😆

                    TBH it's mostly just the same results that df -h gives that I'm normally interested in (i.e. total disk usage). In this case because my backup Volume was getting full up due to so many large Nextcloud backs from lots of updates over the past week.

                    I'm less interested in what the specific apps are using (although that is interesting too, just rarely what I'm actually looking for)

                    Could the two be separated out somehow so that it's possible to just quickly get updated total df -h figures while waiting for all the detail?

                    robiR Offline
                    robiR Offline
                    robi
                    wrote on last edited by
                    #11

                    @jdaviescoates said in Why does refreshing Disk Usage take so long?:

                    Could the two be separated out somehow so that it's possible to just quickly get updated total df -h figures while waiting for all the detail?

                    This is a good idea!

                    Conscious tech

                    1 Reply Last reply
                    1
                    • J Online
                      J Online
                      joseph
                      Staff
                      wrote on last edited by
                      #12

                      @jdaviescoates doesn't answer your suggestion, but you can skip that backup disk from disk usage check . See the bottom of https://docs.cloudron.io/system/#disk-usage . Just add the path into /home/yellowtent/platformdata/diskusage/exclude

                      jdaviescoatesJ 1 Reply Last reply
                      0
                      • J joseph

                        @jdaviescoates doesn't answer your suggestion, but you can skip that backup disk from disk usage check . See the bottom of https://docs.cloudron.io/system/#disk-usage . Just add the path into /home/yellowtent/platformdata/diskusage/exclude

                        jdaviescoatesJ Offline
                        jdaviescoatesJ Offline
                        jdaviescoates
                        wrote on last edited by
                        #13

                        @joseph said in Why does refreshing Disk Usage take so long?:

                        but you can skip that backup disk from disk usage check . See the bottom of https://docs.cloudron.io/system/#disk-usage . Just add the path into /home/yellowtent/platformdata/diskusage/exclude

                        I don't want to skip it! It was the one I wanted to check!

                        I use Cloudron with Gandi & Hetzner

                        1 Reply Last reply
                        1
                        Reply
                        • Reply as topic
                        Log in to reply
                        • Oldest to Newest
                        • Newest to Oldest
                        • Most Votes


                        • Login

                        • Don't have an account? Register

                        • Login or register to search.
                        • First post
                          Last post
                        0
                        • Categories
                        • Recent
                        • Tags
                        • Popular
                        • Bookmarks
                        • Search