Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Search
Skins
  • Light
  • Brite
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

Cloudron Forum

Apps | Demo | Docs | Install
  1. Cloudron Forum
  2. Discuss
  3. AI on Cloudron

AI on Cloudron

Scheduled Pinned Locked Moved Discuss
a.i
256 Posts 17 Posters 142.5k Views 21 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • robiR Offline
    robiR Offline
    robi
    wrote on last edited by robi
    #239

    For those that want to experience how simple it is to build an agent and imagine implementing it on Cloudron.. read on: https://github.com/voxmenthe/coding-agent/blob/main/tutorial.md

    Conscious tech

    1 Reply Last reply
    2
    • L Offline
      L Offline
      LoudLemur
      wrote on last edited by
      #240

      RAG with documents in a Docker
      https://github.com/SciPhi-AI/R2R

      1 Reply Last reply
      0
      • L Offline
        L Offline
        LoudLemur
        wrote on last edited by
        #241

        StabilityMatrix

        If you use a lot of inferencing software, one thing this can do is have the models kept in one folder, which saves storage and bandwidth.

        https://github.com/LykosAI/StabilityMatrix/releases/tag/v2.14.0

        1 Reply Last reply
        0
        • L Offline
          L Offline
          LoudLemur
          wrote on last edited by
          #242

          AI Search with Lepton
          This helps you have an ai language model which makes internet searches.

          An interesting feature that Cloudron might like is its one-click deployment tool.

          https://github.com/leptonai/search_with_lepton?tab=readme-ov-file

          1 Reply Last reply
          0
          • jdaviescoatesJ Offline
            jdaviescoatesJ Offline
            jdaviescoates
            wrote on last edited by
            #243

            Apparently this is one of the best open source models yet:

            https://qwenlm.github.io/blog/qwen3/

            I use Cloudron with Gandi & Hetzner

            L 1 Reply Last reply
            2
            • L Offline
              L Offline
              LoudLemur
              wrote on last edited by
              #244

              LLM VRAM Calculator

              If you would like to know what models your VRAM can handle, you can check with this online tool:

              https://apxml.com/tools/vram-calculator

              1 Reply Last reply
              2
              • jdaviescoatesJ jdaviescoates

                Apparently this is one of the best open source models yet:

                https://qwenlm.github.io/blog/qwen3/

                L Offline
                L Offline
                LoudLemur
                wrote on last edited by
                #245

                @jdaviescoates I just tried it.
                Qwen 3 is very good!

                1 Reply Last reply
                1
                • L Offline
                  L Offline
                  LoudLemur
                  wrote on last edited by
                  #246

                  Live Search is available on Grok's API without charge for a limited time for beta testing:

                  https://docs.x.ai/docs/guides/live-search

                  search through realtime data from 𝕏, the internet, trending news, RSS feeds,

                  necrevistonnezrN 1 Reply Last reply
                  3
                  • L LoudLemur

                    Live Search is available on Grok's API without charge for a limited time for beta testing:

                    https://docs.x.ai/docs/guides/live-search

                    search through realtime data from 𝕏, the internet, trending news, RSS feeds,

                    necrevistonnezrN Offline
                    necrevistonnezrN Offline
                    necrevistonnezr
                    wrote on last edited by necrevistonnezr
                    #247

                    @LoudLemur said in AI on Cloudron:

                    Live Search is available on Grok's API without charge for a limited time for beta testing:

                    https://docs.x.ai/docs/guides/live-search

                    search through realtime data from 𝕏, the internet, trending news, RSS feeds,

                    In the US, Musk is simply walking into the authorities with a presidential power of attorney and copying everything he can. Once the files are copied, they end up in the system of Musk's X AI. Or they are poured into Palantir software with the aim of creating deportation lists.
                    So please boycott this PoS and his PoS endeavors.

                    marcusquinnM 1 Reply Last reply
                    0
                    • necrevistonnezrN necrevistonnezr

                      @LoudLemur said in AI on Cloudron:

                      Live Search is available on Grok's API without charge for a limited time for beta testing:

                      https://docs.x.ai/docs/guides/live-search

                      search through realtime data from 𝕏, the internet, trending news, RSS feeds,

                      In the US, Musk is simply walking into the authorities with a presidential power of attorney and copying everything he can. Once the files are copied, they end up in the system of Musk's X AI. Or they are poured into Palantir software with the aim of creating deportation lists.
                      So please boycott this PoS and his PoS endeavors.

                      marcusquinnM Offline
                      marcusquinnM Offline
                      marcusquinn
                      wrote on last edited by
                      #248

                      @necrevistonnezr Interesting take. Companies are already more powerful that governments in many ways.

                      Web Design & Development: https://www.evergreen.je
                      Technology & Apps: https://www.marcusquinn.com

                      necrevistonnezrN 1 Reply Last reply
                      0
                      • marcusquinnM marcusquinn

                        @necrevistonnezr Interesting take. Companies are already more powerful that governments in many ways.

                        necrevistonnezrN Offline
                        necrevistonnezrN Offline
                        necrevistonnezr
                        wrote on last edited by
                        #249

                        @marcusquinn it’s from an interview with one of the best-known network political activists in Germany Markus Beckedahl. The trained IT merchant created the online medium netzpolitik.org and is one of the founders of the re:publica conference. He is also co-founder of the Society for Freedom Rights, who bring lawsuits dealing with constitutional rigths to court on behalf of citizens. He blogs at digitalpolitik.de.
                        See https://www.heise.de/news/Interview-mit-Markus-Beckedahl-Musk-putscht-mit-Software-statt-Panzern-10379742.html (German)

                        marcusquinnM 1 Reply Last reply
                        2
                        • necrevistonnezrN necrevistonnezr

                          @marcusquinn it’s from an interview with one of the best-known network political activists in Germany Markus Beckedahl. The trained IT merchant created the online medium netzpolitik.org and is one of the founders of the re:publica conference. He is also co-founder of the Society for Freedom Rights, who bring lawsuits dealing with constitutional rigths to court on behalf of citizens. He blogs at digitalpolitik.de.
                          See https://www.heise.de/news/Interview-mit-Markus-Beckedahl-Musk-putscht-mit-Software-statt-Panzern-10379742.html (German)

                          marcusquinnM Offline
                          marcusquinnM Offline
                          marcusquinn
                          wrote on last edited by
                          #250

                          @necrevistonnezr Yeah, seen some not-good reading on demographic targeting by those capturing system admin permissions for cultural preference/detriment/targeting objectives.

                          Doesn't matter what these company leaders and politicians say or do, we all know the power admin permissions can give for the nefarious, and the power that vast amounts of personal data can give for tracking and algo tuning for mind-bending targets.

                          Web Design & Development: https://www.evergreen.je
                          Technology & Apps: https://www.marcusquinn.com

                          1 Reply Last reply
                          1
                          • D Offline
                            D Offline
                            DNA PC
                            wrote on last edited by
                            #251

                            https://localai.io/basics/getting_started/

                            Would be super interesting to get this on Cloudron, they have a Docker port.

                            1 Reply Last reply
                            0
                            • L Offline
                              L Offline
                              LoudLemur
                              wrote on last edited by
                              #252

                              US$4000 mini super computer:
                              https://wccftech.com/nvidia-mini-supercomputer-the-dgx-spark-launches-this-month/

                              1 Reply Last reply
                              1
                              • L Offline
                                L Offline
                                LoudLemur
                                wrote last edited by
                                #253

                                AMD are hosting GPT-OSS-120B on hugging face and it is available gratis and fast:

                                https://huggingface.co/spaces/amd/gpt-oss-120b-chatbot

                                1 Reply Last reply
                                4
                                • E Offline
                                  E Offline
                                  Eventsryoth
                                  wrote last edited by Eventsryoth
                                  #254

                                  Just tried out that AI search engine link you shared, and it’s surprisingly handy. I used it to pull up some obscure PeerTube stuff, and it actually picked up apps I didn’t expect. Also stumbled on an ai detector tool that really made the outputs feel more human—Humanizer AI or something like that. Made the text feel way more natural, like chatting with a person instead of reading a bot response. Definitely going to play around with it more.

                                  marcusquinnM 1 Reply Last reply
                                  0
                                  • E Eventsryoth

                                    Just tried out that AI search engine link you shared, and it’s surprisingly handy. I used it to pull up some obscure PeerTube stuff, and it actually picked up apps I didn’t expect. Also stumbled on an ai detector tool that really made the outputs feel more human—Humanizer AI or something like that. Made the text feel way more natural, like chatting with a person instead of reading a bot response. Definitely going to play around with it more.

                                    marcusquinnM Offline
                                    marcusquinnM Offline
                                    marcusquinn
                                    wrote last edited by marcusquinn
                                    #255

                                    @Eventsryoth FO spam wnkr.

                                    @jdaviescoates @timconsidine you upvoting spam? 😂

                                    @james Spambo links above 👆

                                    Web Design & Development: https://www.evergreen.je
                                    Technology & Apps: https://www.marcusquinn.com

                                    timconsidineT 1 Reply Last reply
                                    2
                                    • marcusquinnM marcusquinn

                                      @Eventsryoth FO spam wnkr.

                                      @jdaviescoates @timconsidine you upvoting spam? 😂

                                      @james Spambo links above 👆

                                      timconsidineT Offline
                                      timconsidineT Offline
                                      timconsidine
                                      App Dev
                                      wrote last edited by
                                      #256

                                      @marcusquinn ooops, well caught, sorry ❎

                                      1 Reply Last reply
                                      2
                                      Reply
                                      • Reply as topic
                                      Log in to reply
                                      • Oldest to Newest
                                      • Newest to Oldest
                                      • Most Votes


                                      • Login

                                      • Don't have an account? Register

                                      • Login or register to search.
                                      • First post
                                        Last post
                                      0
                                      • Categories
                                      • Recent
                                      • Tags
                                      • Popular
                                      • Bookmarks
                                      • Search