Spiderfoot is an open source intelligence (OSINT) automation tool. It integrates with just about every data source available and utilises a range of methods for data analysis, making that data easy to navigate.
Spiderfoot has an embedded web-server for providing a clean and intuitive web-based interface but can also be used completely via the command-line. It's written in Python 3 and GPL-licensed.
Already has an existing docker file
Web based UI or CLI Over 200 modules (see below) Python 3 CSV/JSON/GEXF export API key export/import SQLite back-end for custom querying Highly configurable Fully documented Visualisations TOR integration for dark web searching Dockerfile for Docker-based deployments Can call other tools like DNSTwist, Whatweb, Nmap and CMSeeK Actively developed since 2012!
Self-hosted and focused on data collection. If your use case is focused solely on data collection on small to medium targets and you wish to run SpiderFoot within your own infrastructure that you set up, secure and maintain with support from the community, the open source version is probably the best option for you.
With the open source version, most of the modules from SpiderFoot HX are available, but the ability to navigate, visualize, monitor and investigate is not available. You'll be able to export the data from SpiderFoot in CSV, JSON or GEXF and work with the data in other tools.
The open source version is typically used by hobbyists and those new to OSINT.