Spiderfoot

[privsec]

Spiderfoot is an open source intelligence (OSINT) automation tool. It integrates with just about every data source available and utilises a range of methods for data analysis, making that data easy to navigate.

Spiderfoot has an embedded web-server for providing a clean and intuitive web-based interface but can also be used completely via the command-line. It's written in Python 3 and GPL-licensed.

Already has an existing docker file

FEATURES

Web based UI or CLI
Over 200 modules (see below)
Python 3
CSV/JSON/GEXF export
API key export/import
SQLite back-end for custom querying
Highly configurable
Fully documented
Visualisations
TOR integration for dark web searching
Dockerfile for Docker-based deployments
Can call other tools like DNSTwist, Whatweb, Nmap and CMSeeK
Actively developed since 2012!

Self-hosted and focused on data collection. If your use case is focused solely on data collection on small to medium targets and you wish to run SpiderFoot within your own infrastructure that you set up, secure and maintain with support from the community, the open source version is probably the best option for you.

With the open source version, most of the modules from SpiderFoot HX are available, but the ability to navigate, visualize, monitor and investigate is not available. You'll be able to export the data from SpiderFoot in CSV, JSON or GEXF and work with the data in other tools.

The open source version is typically used by hobbyists and those new to OSINT.