Cloudron makes it easy to run web apps like WordPress, Nextcloud, GitLab on your server. Find out more or install now.


Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • Bookmarks
  • Search
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Brand Logo

Cloudron Forum

Apps | Demo | Docs | Install
  1. Cloudron Forum
  2. App Wishlist
  3. Photon Site Crawler - OSINT Tool

Photon Site Crawler - OSINT Tool

Scheduled Pinned Locked Moved App Wishlist
osintphotonsite crawler
1 Posts 1 Posters 270 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
    Reply
    • Reply as topic
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • P Offline
      P Offline
      privsec
      wrote on last edited by
      #1

      Photon is a webcrawling application. It has a Docker image already.

      Key Features

      Data Extraction

      Photon can extract the following data while crawling:

      URLs (in-scope & out-of-scope)
      URLs with parameters (example.com/gallery.php?id=2)
      Intel (emails, social media accounts, amazon buckets etc.)
      Files (pdf, png, xml etc.)
      Secret keys (auth/API keys & hashes)
      JavaScript files & Endpoints present in them
      Strings matching custom regex pattern
      Subdomains & DNS related data
      

      Flexible

      Control timeout, delay, add seeds, exclude URLs matching a regex pattern and other cool stuff. The extensive range of options provided by Photon lets you crawl the web exactly the way you want.
      Genius

      Photon's smart thread management & refined logic gives you top notch performance.

      Still, crawling can be resource intensive but Photon has some tricks up it's sleeves. You can fetch URLs archived by archive.org to be used as seeds by using --wayback option.

      Plugins

      wayback
      dnsdumpster
      Exporter

      1 Reply Last reply
      5
      Reply
      • Reply as topic
      Log in to reply
      • Oldest to Newest
      • Newest to Oldest
      • Most Votes


        • Login

        • Don't have an account? Register

        • Login or register to search.
        • First post
          Last post
        0
        • Categories
        • Recent
        • Tags
        • Popular
        • Bookmarks
        • Search