Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Search
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

Cloudron Forum

Apps | Demo | Docs | Install
  1. Cloudron Forum
  2. NodeBB
  3. classify health check as bot page view

classify health check as bot page view

Scheduled Pinned Locked Moved Solved NodeBB
11 Posts 5 Posters 761 Views 5 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • BrutalBirdieB Offline
    BrutalBirdieB Offline
    BrutalBirdie
    Partner
    wrote on last edited by
    #2

    First, how does NodeBB differentiate between "Page Views Bot" and normal views?

    IMO since the healthcheck always requests the same path from the same ip, it should get picked up.
    If not, maybe some header check? 🤷

    From 2022 https://github.com/NodeBB/NodeBB/issues/10780
    which seems still to be the case https://github.com/search?q=repo%3ANodeBB%2FNodeBB spider-detector&type=code

    Still this does not answer me HOW they identify a bot 😆 must be somewhere in there.

    Like my work? Consider donating a drink. Cheers!

    andreasduerenA 1 Reply Last reply
    3
    • girishG Offline
      girishG Offline
      girish
      Staff
      wrote on last edited by
      #3

      The healthcheck box uses Mozilla (CloudronHealth) as the user agent and will always come from 172.18.0.1 (if these help in filtering...)

      1 Reply Last reply
      2
      • BrutalBirdieB BrutalBirdie

        First, how does NodeBB differentiate between "Page Views Bot" and normal views?

        IMO since the healthcheck always requests the same path from the same ip, it should get picked up.
        If not, maybe some header check? 🤷

        From 2022 https://github.com/NodeBB/NodeBB/issues/10780
        which seems still to be the case https://github.com/search?q=repo%3ANodeBB%2FNodeBB spider-detector&type=code

        Still this does not answer me HOW they identify a bot 😆 must be somewhere in there.

        andreasduerenA Offline
        andreasduerenA Offline
        andreasdueren
        wrote on last edited by
        #4

        @BrutalBirdie I guess this is what they classify as bots then https://github.com/binarykitchen/spider-detector/blob/master/index.js

        1 Reply Last reply
        1
        • barisB Offline
          barisB Offline
          baris
          wrote on last edited by
          #5

          We have a route at https://forum.cloudron.io/sping that we use for up time checks, requests to that route do not count as pageviews.

          andreasduerenA BrutalBirdieB 2 Replies Last reply
          4
          • barisB baris

            We have a route at https://forum.cloudron.io/sping that we use for up time checks, requests to that route do not count as pageviews.

            andreasduerenA Offline
            andreasduerenA Offline
            andreasdueren
            wrote on last edited by andreasdueren
            #6

            @baris Nice! @girish

            1 Reply Last reply
            2
            • barisB baris

              We have a route at https://forum.cloudron.io/sping that we use for up time checks, requests to that route do not count as pageviews.

              BrutalBirdieB Offline
              BrutalBirdieB Offline
              BrutalBirdie
              Partner
              wrote on last edited by
              #7

              @baris wow! Great to know!
              This is not documented anywhere, right? 🤔

              Only present in code and no doc files.
              https://github.com/search?q=repo%3ANodeBB%2FNodeBB+sping&type=code
              https://docs.nodebb.org/ nothing about sping 🤷

              Like my work? Consider donating a drink. Cheers!

              barisB 1 Reply Last reply
              3
              • nebulonN Away
                nebulonN Away
                nebulon
                Staff
                wrote on last edited by
                #8

                Great find indeed. I will prepare a package update to use /ping for healthchecks

                1 Reply Last reply
                1
                • nebulonN Away
                  nebulonN Away
                  nebulon
                  Staff
                  wrote on last edited by
                  #9

                  new package is out

                  1 Reply Last reply
                  2
                  • BrutalBirdieB BrutalBirdie

                    @baris wow! Great to know!
                    This is not documented anywhere, right? 🤔

                    Only present in code and no doc files.
                    https://github.com/search?q=repo%3ANodeBB%2FNodeBB+sping&type=code
                    https://docs.nodebb.org/ nothing about sping 🤷

                    barisB Offline
                    barisB Offline
                    baris
                    wrote on last edited by
                    #10

                    @BrutalBirdie nice catch, I've added it into our openapi spec, so it will show up at https://docs.nodebb.org/api/read/ after 4.3.0 is released.

                    https://github.com/NodeBB/NodeBB/commit/8ffbc35923cc8f9a785a8edb80d52991a885ec22

                    BrutalBirdieB 1 Reply Last reply
                    4
                    • barisB baris

                      @BrutalBirdie nice catch, I've added it into our openapi spec, so it will show up at https://docs.nodebb.org/api/read/ after 4.3.0 is released.

                      https://github.com/NodeBB/NodeBB/commit/8ffbc35923cc8f9a785a8edb80d52991a885ec22

                      BrutalBirdieB Offline
                      BrutalBirdieB Offline
                      BrutalBirdie
                      Partner
                      wrote on last edited by BrutalBirdie
                      #11

                      @baris Ahhhhh so you are https://github.com/barisusakli
                      That explains a lot.
                      I was thinking, who is this first time poster and how does he know this 😄
                      Welcome to the Cloudrom Forum! 👋

                      And since you are who you are 😏 and you are reading this right now 😏
                      Could you give https://forum.cloudron.io/topic/13687/have-chats-been-turned-of-on-purpose a read? Pretty please 😁

                      Like my work? Consider donating a drink. Cheers!

                      1 Reply Last reply
                      4
                      • J joseph has marked this topic as solved on
                      Reply
                      • Reply as topic
                      Log in to reply
                      • Oldest to Newest
                      • Newest to Oldest
                      • Most Votes


                      • Login

                      • Don't have an account? Register

                      • Login or register to search.
                      • First post
                        Last post
                      0
                      • Categories
                      • Recent
                      • Tags
                      • Popular
                      • Bookmarks
                      • Search