Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse

Cloudron Forum

Apps | Demo | Docs | Install

Is a non JS version possible? How to wget files?

Scheduled Pinned Locked Moved Solved Surfer
22 Posts 5 Posters 829 Views
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • jdaviescoatesJ Offline
    jdaviescoatesJ Offline
    jdaviescoates
    wrote on last edited by
    #1

    @scooke notified me that people on reddit have found my Tools for Change library of resources:

    https://www.reddit.com/r/opendirectories/comments/l0hbvw/just_a_collection_of_a_tons_of_pdfs/

    Quite a few people have noted that they are unable to download it all using wget etc.

    Is there are way to let people browse the files without JS and to be able to download using wget?

    I use Cloudron with Gandi & Hetzner

    marcusquinnM 1 Reply Last reply
    1
  • marcusquinnM Offline
    marcusquinnM Offline
    marcusquinn
    replied to jdaviescoates on last edited by
    #2

    @jdaviescoates I use "SiteSucker" for that kind of thing. I'm on Mac but there might be a Windoze version.

    We're not here for a long time - but we are here for a good time :)
    Jersey/UK
    Work & Ecommerce Advice: https://brandlight.org
    Personal & Software Tips: https://marcusquinn.com

    1 Reply Last reply
    1
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    wrote on last edited by
    #3

    Do you mean like downloading a whole folder tree or so? The individual pdfs work fine to wget.

    Otherwise how is this done with wget for other pages? I guess some recoursive link grabbing?

    jdaviescoatesJ 1 Reply Last reply
    0
  • jdaviescoatesJ Offline
    jdaviescoatesJ Offline
    jdaviescoates
    replied to nebulon on last edited by
    #4

    @nebulon said in Is a non JS version possible? How to wget files?:

    Do you mean like downloading a whole folder tree or so?

    Yes, for people who want to download the whole thing. All the folders at once.

    I use Cloudron with Gandi & Hetzner

    nebulonN 1 Reply Last reply
    0
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    replied to jdaviescoates on last edited by
    #5

    @jdaviescoates hm indeed this is currently not supported. There are no server-side rendering capabilities to provide such a page. Do you think giving the option to download a folder tree as a zip or tarball would make sense?

    mehdiM 1 Reply Last reply
    0
  • mehdiM Offline
    mehdiM Offline
    mehdi App Dev
    replied to nebulon on last edited by
    #6

    @nebulon I think a simple server-side rendering of a list of links when listing a folder would be better than the ability to download a hole folder as tar. That's the way nginx / apache do it, and it shouldn't be too hard to implement IMO

    1 Reply Last reply
    2
  • robiR Offline
    robiR Offline
    robi
    wrote on last edited by
    #7

    you can provide a convenience zip/tgz via the terminal.. and with a cron feature do it regularly.

    Life of sky tech

    1 Reply Last reply
    1
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    wrote on last edited by
    #8

    I've added basic support for file listing together with the <noscript> tag, which allows the usage of wget -r or also text based browsers like lynx.

    Conveniently it also removes one server roundtrip for the dynamic version as the template also injects the folder content with a <script> tag to pickup by the vuejs app.

    This is only for the public page so far and pending a surfer package release (hopefully tomorrow)

    If anyone is interested, the change is at https://github.com/cloudron-io/surfer/commit/4d70d060961422a50528c9186061d458d261aa3d

    I actually had a hard time to test this in firefox, since the noscript addon would simply not execute javascript, but ignores the <noscript> tag. Does anyone know how to test such a scenario?

    mehdiM jdaviescoatesJ 2 Replies Last reply
    2
  • mehdiM Offline
    mehdiM Offline
    mehdi App Dev
    replied to nebulon on last edited by
    #9

    @nebulon What I do in this case is not put the elements destined for non-JS environment in a noscript tag, but rather just put them at the root of the element that's gonna be the Vue.JS app. So, as soon as Vue.JS takes over, it disappears.

    nebulonN 1 Reply Last reply
    1
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    replied to mehdi on last edited by
    #10

    @mehdi thats kinda smart, I have to see how much flickering that adds to the UI as such, but otherwise I think I'd prefer your solution.

    1 Reply Last reply
    1
  • jdaviescoatesJ Offline
    jdaviescoatesJ Offline
    jdaviescoates
    replied to nebulon on last edited by
    #11

    @nebulon sounds like you're making great progress, thanks!

    I use Cloudron with Gandi & Hetzner

    nebulonN 1 Reply Last reply
    0
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    replied to jdaviescoates on last edited by
    #12

    @jdaviescoates I published a new version 5.16.0 which has basic noscript support.
    I decided against @mehdi 's suggestion, since the UI flicker during folder navigation was a bit too much. Generally I would have preferred that though.

    jdaviescoatesJ 1 Reply Last reply
    2
  • jdaviescoatesJ Offline
    jdaviescoatesJ Offline
    jdaviescoates
    replied to nebulon on last edited by
    #13

    @nebulon great, thanks! I'll let that reddit thread know and see if the people who were having issues before are OK now 🙂

    I use Cloudron with Gandi & Hetzner

    jdaviescoatesJ 1 Reply Last reply
    1
  • jdaviescoatesJ Offline
    jdaviescoatesJ Offline
    jdaviescoates
    replied to jdaviescoates on last edited by
    #14

    @nebulon I just tried doing wget -r myself and it worked perfectly! 😄

    However, if you e.g. install noscript extension and visit it you can't actually scroll down pages. 😕

    So even though it's now possible to wget the files (which is great, thanks!), it's still not possible to simply browse the files in a browser without javascript enabled.

    It'd be awesome if that could be made possible too!? 🙂

    I use Cloudron with Gandi & Hetzner

    mehdiM 1 Reply Last reply
    0
  • mehdiM Offline
    mehdiM Offline
    mehdi App Dev
    replied to jdaviescoates on last edited by
    #15

    @jdaviescoates NoScript is different from "a browser without javascript enabled". NoScript removes the script tags, but does not disable javascript. If you go to another browser, actually disable javascript in the preferences, it should work

    jdaviescoatesJ 1 Reply Last reply
    1
  • jdaviescoatesJ Offline
    jdaviescoatesJ Offline
    jdaviescoates
    replied to mehdi on last edited by
    #16

    @mehdi said in Is a non JS version possible? How to wget files?:

    If you go to another browser, actually disable javascript in the preferences, it should work

    I just tried that too, but it doesn't seem to work. Still can't scroll down pages e.g. https://library.uniteddiversity.coop/Cooperatives/

    I use Cloudron with Gandi & Hetzner

    1 Reply Last reply
    0
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    wrote on last edited by
    #17

    As @mehdi mentiones the NoScript extension is not the right thing here, but if you go to about:config in Firefox and set javascript.enabled to false, then even without a browser restart you would see the static page instead. Haven't tested chrome based browser though.

    jdaviescoatesJ 1 Reply Last reply
    0
  • jdaviescoatesJ Offline
    jdaviescoatesJ Offline
    jdaviescoates
    replied to nebulon on last edited by
    #18

    @nebulon thanks, but even just doing that (and the equivalent in Chromium) it's not that I don't see the static page, I do. It's that you can't scroll down the page and browse files further down the page.

    e.g. turn off javascript and go here: https://library.uniteddiversity.coop/Cooperatives/ and you can't get past here:

    can't scroll down.png

    I use Cloudron with Gandi & Hetzner

    nebulonN 1 Reply Last reply
    0
  • nebulonN Offline
    nebulonN Offline
    nebulon Staff
    replied to jdaviescoates on last edited by
    #19

    @jdaviescoates well that is the basic noscript page for now. I guess it is not sorted nor gives indication of the filetype, yet.

    jdaviescoatesJ 1 Reply Last reply
    0
  • jdaviescoatesJ Offline
    jdaviescoatesJ Offline
    jdaviescoates
    replied to nebulon on last edited by
    #20

    @nebulon said in Is a non JS version possible? How to wget files?:

    I guess it is not sorted nor gives indication of the filetype, yet.

    Well, it looks like it is sorted alphabetically anyway and you can see the filetype anyway from the filename.

    Just can't scroll down the page.

    But you've solved the primary issue of not being able to wget the files so thanks for that.

    I use Cloudron with Gandi & Hetzner

    nebulonN 1 Reply Last reply
    0

  • Login

  • Don't have an account? Register

  • Login or register to search.
  • First post
    Last post
0
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Login

  • Don't have an account? Register

  • Login or register to search.