Information Gathering
HTTPX is a fast, multi-purpose HTTP toolkit by ProjectDiscovery that probes web servers for live status, extracts page titles, detects technologies, captures screenshots, and analyzes response headers — making it essential for reconnaissance pipelines, bug bounty hunting, and penetration testing.
sudo apt install httpx-toolkit
httpx [options]
HTTPX is a fast, multi-purpose HTTP toolkit developed by ProjectDiscovery. It probes web servers to determine if they are alive, extracts metadata like page titles and status codes, identifies technologies and frameworks, and can capture screenshots of web pages. HTTPX is the industry standard for HTTP probing in reconnaissance pipelines.
The tool is designed to process large lists of hosts efficiently using Go's concurrency model with goroutines. It maintains result reliability while achieving high speeds, making it ideal for processing thousands of subdomains discovered during reconnaissance. HTTPX can handle 1000+ concurrent HTTP requests with configurable thread pools.
HTTPX integrates seamlessly with other ProjectDiscovery tools. It accepts output from Subfinder, Amass, and other subdomain discovery tools, then feeds its results into Nuclei for vulnerability scanning. This creates a complete automated reconnaissance pipeline: Subfinder discovers subdomains, HTTPX identifies live hosts, and Nuclei scans for vulnerabilities.
The tool supports multiple output formats including JSON, CSV, and plain text, making it easy to integrate into existing security workflows and scripts. HTTPX also provides technology fingerprinting, redirect following, custom headers, proxy support, and content-based filtering for flexible reconnaissance operations.
echo example.com | httpx -title -status-codeProbe status - Check if host is alive, displaying HTTP status codes and page titleshttpx -l subdomains.txt -tech-detectTechnology probe - Analyze a complete list of endpoints for operational frameworkscat subs.txt | httpxProbe subdomainshttpx -l hosts.txt -status-codeShow status codeshttpx -l hosts.txt -title -tech-detectTitle and tech detectionhttpx -l hosts.txt -screenshotTake screenshotshttpx -l urls.txt -status-code -title -tech-detectProbe URLs with status, title, and tech detectionhttpx -l urls.txt -json -o results.jsonJSON output for pipeline processinghttpx -l urls.txt -follow-redirects -max-redir 5Follow up to 5 redirectshttpx -l urls.txt -threads 50 -rate-limit 10050 threads at 100 req/shttpx -l urls.txt -extract-title -content-lengthExtract title and content lengthhttpx -l urls.txt -ports 80,443,8080,8443Scan multiple portshttpx -l urls.txt -screenshot -o screenshots/Take screenshots of live hostshttpx -l urls.txt -cdn -cnameDetect CDN and CNAME recordshttpx -l urls.txt -ip -dns-resolver 8.8.8.8Resolve to IP using custom DNSIdentify which subdomains from a discovery scan are actually hosting web services and serving HTTP content.
Detect frameworks, CMS, libraries, server software, and JavaScript libraries running on web applications.
Automatically capture screenshots of web pages for visual reconnaissance and reporting documentation.
Identify redirect chains, error pages, access restrictions, and response patterns across large host lists.
Process output from Subfinder and feed results into Nuclei for automated end-to-end vulnerability scanning.
Find and catalog web applications across an organization's entire external infrastructure.
Quickly identify live targets from large subdomain lists for focused vulnerability testing.
Map the complete web-facing attack surface by probing all discovered subdomains and domains.
| Feature | httpx | curl | WhatWeb |
|---|---|---|---|
| Primary Use | Bulk live-host probing | Single HTTP request | Deep tech fingerprinting |
| Bulk Processing | Yes (1000s of hosts) | No (one at a time) | Yes (slower) |
| Concurrency | Go goroutines | None | Limited |
| Tech Detection | Fast, 150+ techs | None | Deep, plugin-based |
| Screenshots | Yes (headless Chromium) | No | No |
| Output | TXT/JSON/CSV | Raw response | TXT/JSON/XML |
| Best For | Triaging large host lists | Debugging one endpoint | Detailed per-target analysis |
| Feature | Subfinder | httpx | Nuclei |
|---|---|---|---|
| Stage | 1. Discovery | 2. Live detection | 3. Vuln scanning |
| Traffic to Target | None (passive) | HTTP requests (active) | Templated requests (active) |
| Input | Root domain | Subdomain list | Live URL list |
| Output | Subdomains | Live URLs + metadata | Findings |
| Typical Flag | -d example.com | -title -status-code -tech-detect | -t cves/ |
| Feature | httpx | Nmap |
|---|---|---|
| Focus | HTTP/HTTPS layer | Full TCP/UDP ports |
| Speed on Web Hosts | Very fast (purpose-built) | Slower for HTTP metadata |
| Title / Tech Extraction | Built-in | Via http-* NSE scripts |
| Non-HTTP Services | No | Yes (SSH, DB, etc.) |
| Best For | Web-focused triage at scale | Full port and service discovery |
httpx is a multi-purpose HTTP toolkit designed for reconnaissance pipelines — it probes hosts for live status, extracts titles, detects technologies, captures screenshots, and analyzes headers in bulk. curl is a general-purpose HTTP client for single requests and API testing. Use httpx for scanning lists of subdomains; use curl for targeted single-host requests.
A common recon pipeline pipes Subfinder output into httpx: subfinder -d example.com -silent | httpx -silent. Subfinder discovers subdomains passively, then httpx probes each to find which ones are live, extracts status codes, titles, and technologies. This combination is the standard first step in bug bounty reconnaissance.
Yes. Use the -screenshot flag to capture screenshots of live web servers. httpx requires Chromium or Chrome installed on the system for screenshot functionality. Screenshots are useful for visual reconnaissance, identifying login pages, and documenting web applications during penetration testing.
Yes. Use -tech-detect to identify web technologies, frameworks, CMS platforms, and server software running on target hosts. httpx detects technologies from HTTP headers, meta tags, script sources, and cookie patterns. Combine with -json for structured output of detected technologies.
httpx uses a default concurrency of 25 threads for probing hosts. Increase with -c 50 or -c 100 for larger target lists, but monitor for rate limiting and blocking. Start with defaults and increase gradually. Use -rl to set a rate limit (requests per second) to avoid overwhelming targets.
httpx is active — it sends HTTP/HTTPS requests to each target host to determine live status, extract content, and detect technologies. This generates network traffic that can be logged by the target. For passive HTTP reconnaissance, use certificate transparency logs and search engines instead.
Information Gathering
Passive subdomain discovery tool that feeds targets into httpx for probing.
Web Application
Vulnerability scanner for testing live hosts identified by httpx for known CVEs.
Web Application
Deep technology fingerprinting with extensive plugin database for specific targets.
Information Gathering
Network scanner for port discovery on hosts identified by httpx.
Web Application
Directory brute-forcer for discovering hidden content on live hosts.
Information Gathering
Internet-scale port scanner for discovering additional services on httpx-identified hosts.
Information Gathering
Passive subdomain discovery tool that feeds targets into httpx for probing.
This tool is designed for authorized security testing, educational purposes, and legitimate network administration only. Unauthorized access to computer systems is illegal.