GO KALI FREE

httpx

Information Gathering

Beginnerlow risk

HTTPX is a fast, multi-purpose HTTP toolkit by ProjectDiscovery that probes web servers for live status, extracts page titles, detects technologies, captures screenshots, and analyzes response headers — making it essential for reconnaissance pipelines, bug bounty hunting, and penetration testing.

Installation

sudo apt install httpx-toolkit

Basic Syntax

httpx [options]

Quick Facts

Full Name
HTTPX
License
MIT License
Developer
ProjectDiscovery
Written In
Go (Golang)
Platforms
Linux, macOS, Windows
Category
HTTP Probing / Reconnaissance
First Release
2019
GitHub Stars
8,000+
Concurrency
Configurable goroutine pool
Default on Kali
Yes
Difficulty
Beginner
Prerequisites
Target list from Subfinder/Amass

Tool Overview

HTTPX is a fast, multi-purpose HTTP toolkit developed by ProjectDiscovery. It probes web servers to determine if they are alive, extracts metadata like page titles and status codes, identifies technologies and frameworks, and can capture screenshots of web pages. HTTPX is the industry standard for HTTP probing in reconnaissance pipelines.

The tool is designed to process large lists of hosts efficiently using Go's concurrency model with goroutines. It maintains result reliability while achieving high speeds, making it ideal for processing thousands of subdomains discovered during reconnaissance. HTTPX can handle 1000+ concurrent HTTP requests with configurable thread pools.

HTTPX integrates seamlessly with other ProjectDiscovery tools. It accepts output from Subfinder, Amass, and other subdomain discovery tools, then feeds its results into Nuclei for vulnerability scanning. This creates a complete automated reconnaissance pipeline: Subfinder discovers subdomains, HTTPX identifies live hosts, and Nuclei scans for vulnerabilities.

The tool supports multiple output formats including JSON, CSV, and plain text, making it easy to integrate into existing security workflows and scripts. HTTPX also provides technology fingerprinting, redirect following, custom headers, proxy support, and content-based filtering for flexible reconnaissance operations.

Common Commands

echo example.com | httpx -title -status-codeProbe status - Check if host is alive, displaying HTTP status codes and page titles
httpx -l subdomains.txt -tech-detectTechnology probe - Analyze a complete list of endpoints for operational frameworks
cat subs.txt | httpxProbe subdomains
httpx -l hosts.txt -status-codeShow status codes
httpx -l hosts.txt -title -tech-detectTitle and tech detection
httpx -l hosts.txt -screenshotTake screenshots
httpx -l urls.txt -status-code -title -tech-detectProbe URLs with status, title, and tech detection
httpx -l urls.txt -json -o results.jsonJSON output for pipeline processing
httpx -l urls.txt -follow-redirects -max-redir 5Follow up to 5 redirects
httpx -l urls.txt -threads 50 -rate-limit 10050 threads at 100 req/s
httpx -l urls.txt -extract-title -content-lengthExtract title and content length
httpx -l urls.txt -ports 80,443,8080,8443Scan multiple ports
httpx -l urls.txt -screenshot -o screenshots/Take screenshots of live hosts
httpx -l urls.txt -cdn -cnameDetect CDN and CNAME records
httpx -l urls.txt -ip -dns-resolver 8.8.8.8Resolve to IP using custom DNS

Step-by-Step Guide

  1. 1Compile a text file containing a list of target URLs or subdomains
  2. 2Pipe the list directly into the httpx command line
  3. 3Include specific flags to extract page titles, response codes, or server technologies
  4. 4Filter the final output to isolate live hosts from dead ones

Use Cases

Live Host Detection

Identify which subdomains from a discovery scan are actually hosting web services and serving HTTP content.

Technology Fingerprinting

Detect frameworks, CMS, libraries, server software, and JavaScript libraries running on web applications.

Screenshot Capture

Automatically capture screenshots of web pages for visual reconnaissance and reporting documentation.

Status Code Analysis

Identify redirect chains, error pages, access restrictions, and response patterns across large host lists.

Recon Pipeline Integration

Process output from Subfinder and feed results into Nuclei for automated end-to-end vulnerability scanning.

Web Application Discovery

Find and catalog web applications across an organization's entire external infrastructure.

Bug Bounty Reconnaissance

Quickly identify live targets from large subdomain lists for focused vulnerability testing.

Attack Surface Mapping

Map the complete web-facing attack surface by probing all discovered subdomains and domains.

Key Features

Comparison

httpx vs curl vs WhatWeb — HTTP Recon Matrix

FeaturehttpxcurlWhatWeb
Primary UseBulk live-host probingSingle HTTP requestDeep tech fingerprinting
Bulk ProcessingYes (1000s of hosts)No (one at a time)Yes (slower)
ConcurrencyGo goroutinesNoneLimited
Tech DetectionFast, 150+ techsNoneDeep, plugin-based
ScreenshotsYes (headless Chromium)NoNo
OutputTXT/JSON/CSVRaw responseTXT/JSON/XML
Best ForTriaging large host listsDebugging one endpointDetailed per-target analysis

Where httpx Sits in the Recon Pipeline

FeatureSubfinderhttpxNuclei
Stage1. Discovery2. Live detection3. Vuln scanning
Traffic to TargetNone (passive)HTTP requests (active)Templated requests (active)
InputRoot domainSubdomain listLive URL list
OutputSubdomainsLive URLs + metadataFindings
Typical Flag-d example.com-title -status-code -tech-detect-t cves/

httpx vs Nmap for Web Service Checks

FeaturehttpxNmap
FocusHTTP/HTTPS layerFull TCP/UDP ports
Speed on Web HostsVery fast (purpose-built)Slower for HTTP metadata
Title / Tech ExtractionBuilt-inVia http-* NSE scripts
Non-HTTP ServicesNoYes (SSH, DB, etc.)
Best ForWeb-focused triage at scaleFull port and service discovery

Best Practices

Common Errors

httpx: command not found
Install with: go install -v github.com/projectdiscovery/httpx/cmd/httpx@latest
screenshot: chromium not found
Install Chromium: sudo apt install chromium
context deadline exceeded
Increase timeout with -timeout 30 or check network connectivity
no results found
Verify input file exists and contains valid hostnames
too many open files
Increase ulimit: ulimit -n 65535 before running httpx

People Also Ask

What is the difference between httpx and curl?

httpx is a multi-purpose HTTP toolkit designed for reconnaissance pipelines — it probes hosts for live status, extracts titles, detects technologies, captures screenshots, and analyzes headers in bulk. curl is a general-purpose HTTP client for single requests and API testing. Use httpx for scanning lists of subdomains; use curl for targeted single-host requests.

How does httpx integrate with Subfinder?

A common recon pipeline pipes Subfinder output into httpx: subfinder -d example.com -silent | httpx -silent. Subfinder discovers subdomains passively, then httpx probes each to find which ones are live, extracts status codes, titles, and technologies. This combination is the standard first step in bug bounty reconnaissance.

Can httpx take screenshots of websites?

Yes. Use the -screenshot flag to capture screenshots of live web servers. httpx requires Chromium or Chrome installed on the system for screenshot functionality. Screenshots are useful for visual reconnaissance, identifying login pages, and documenting web applications during penetration testing.

Does httpx support technology detection?

Yes. Use -tech-detect to identify web technologies, frameworks, CMS platforms, and server software running on target hosts. httpx detects technologies from HTTP headers, meta tags, script sources, and cookie patterns. Combine with -json for structured output of detected technologies.

What is the httpx concurrency setting?

httpx uses a default concurrency of 25 threads for probing hosts. Increase with -c 50 or -c 100 for larger target lists, but monitor for rate limiting and blocking. Start with defaults and increase gradually. Use -rl to set a rate limit (requests per second) to avoid overwhelming targets.

Is httpx passive or active?

httpx is active — it sends HTTP/HTTPS requests to each target host to determine live status, extract content, and detect technologies. This generates network traffic that can be logged by the target. For passive HTTP reconnaissance, use certificate transparency logs and search engines instead.

Related Tools

Subfinder

Information Gathering

Passive subdomain discovery tool that feeds targets into httpx for probing.

Nuclei

Web Application

Vulnerability scanner for testing live hosts identified by httpx for known CVEs.

WhatWeb

Web Application

Deep technology fingerprinting with extensive plugin database for specific targets.

Nmap

Information Gathering

Network scanner for port discovery on hosts identified by httpx.

Gobuster

Web Application

Directory brute-forcer for discovering hidden content on live hosts.

Masscan

Information Gathering

Internet-scale port scanner for discovering additional services on httpx-identified hosts.

Subfinder

Information Gathering

Passive subdomain discovery tool that feeds targets into httpx for probing.

Frequently Asked Questions

What is HTTPX tool?

HTTPX is a fast, multi-purpose HTTP toolkit developed by ProjectDiscovery. It probes web servers to determine if they are alive, extracts page titles and status codes, identifies technologies and frameworks, captures screenshots, and detects response headers. It is a key tool in reconnaissance pipelines for penetration testing and bug bounty hunting.

How does HTTPX work?

HTTPX works by sending HTTP requests to target hosts and analyzing the responses. It checks for HTTP status codes, extracts page titles, identifies technology patterns in response headers and content, and can capture screenshots using headless Chromium. It processes targets concurrently using Go's goroutine model for high-speed bulk probing.

Is HTTPX free?

Yes, HTTPX is completely free and open source under the MIT license. It is developed by ProjectDiscovery and available on Kali Linux by default. You can install it from GitHub or use the apt package manager.

Who developed HTTPX?

HTTPX was developed by ProjectDiscovery, a cybersecurity company that builds open-source security tools. ProjectDiscovery also created Nuclei, Subfinder, and many other popular reconnaissance and security tools used by penetration testers and bug bounty hunters worldwide.

What is ProjectDiscovery?

ProjectDiscovery is a cybersecurity company and open-source project that develops reconnaissance and security tools. Their most popular tools include HTTPX, Nuclei, Subfinder, and Chaos. These tools work together as a complete reconnaissance pipeline for penetration testing and bug bounty programs.

How do I install HTTPX?

On Kali Linux: sudo apt install httpx-toolkit. On other systems: go install -v github.com/projectdiscovery/httpx/cmd/httpx@latest. Verify with httpx -version. You can also download pre-built binaries from the GitHub releases page.

Can beginners use HTTPX?

Yes, HTTPX is beginner-friendly. Start with a simple command like httpx -l hosts.txt -title -status-code. Pipe output from Subfinder directly into HTTPX. The tool has a gentle learning curve and produces immediately useful results.

Is HTTPX good for bug bounty?

Yes, HTTPX is essential for bug bounty reconnaissance. It identifies live hosts from subdomain lists, detects technologies to focus testing efforts, and integrates seamlessly with Nuclei for automated vulnerability scanning. Most bug bounty hunters use HTTPX as a core step in their recon pipeline.

What programming language is HTTPX written in?

HTTPX is written in Go (Golang). This gives it excellent performance through concurrent goroutine processing, cross-platform compatibility, and easy installation via go install. The Go language enables HTTPX to process thousands of hosts simultaneously.

What is the difference between HTTPX and Nmap?

HTTPX focuses on HTTP/HTTPS probing — detecting live web servers, extracting titles, identifying technologies, and capturing screenshots. Nmap is a comprehensive network scanner for port discovery, service detection, and OS fingerprinting. HTTPX excels at web reconnaissance; Nmap excels at network mapping.

What is the difference between HTTPX and WhatWeb?

HTTPX is faster and better for bulk HTTP probing and live host detection with basic technology identification. WhatWeb provides deeper technology fingerprinting through plugin-based analysis. Use HTTPX first for speed, then WhatWeb for detailed technology analysis on interesting targets.

Can HTTPX detect live hosts?

Yes, detecting live hosts is HTTPX's primary function. It sends HTTP requests to each target and reports which ones return valid HTTP responses. Use -status-code to see response codes and -title to extract page names from live hosts.

Can HTTPX take screenshots?

Yes, HTTPX can capture screenshots using the -screenshot flag. This requires Chromium or Chrome headless browser to be installed. Screenshots are saved to the output directory and are useful for visual reconnaissance and reporting.

How do I use HTTPX with Subfinder?

Pipe Subfinder output directly to HTTPX: subfinder -d target.com | httpx -title -status-code -tech-detect. This discovers subdomains and immediately probes them for live hosts, page titles, and technologies in a single pipeline.

What output formats does HTTPX support?

HTTPX supports JSON (-json), CSV (-csv), and plain text output. JSON is best for programmatic processing and tool integration. CSV is useful for spreadsheet analysis. Plain text is easiest for manual review. Use -o to save output to a file.

Can HTTPX detect web technologies?

Yes, the -tech-detect flag identifies frameworks, CMS, servers, and libraries through response header analysis and pattern matching. It detects WordPress, Laravel, React, Angular, Nginx, Apache, and many more technologies.

How do I control HTTPX scan speed?

Use -c or -threads to set concurrent requests (default: 25). Higher values increase speed but may trigger rate limiting. Use -delay to add delays between requests. Start with -c 10 for sensitive targets and increase as needed.

Can HTTPX follow redirects?

Yes, use -follow-redirects to track redirect chains and report the final destination URL. This is useful for identifying URL shorteners, domain redirects, and HTTP-to-HTTPS redirects that mask the actual target.

How do I filter HTTPX results?

Use -fc to filter out specific status codes (e.g., -fc 404,403). Use -mc to match only specific codes (e.g., -mc 200,301). Use -cl to filter by content length. Use -title to filter by page title text.

Can HTTPX use proxies?

Yes, use -proxy to route all HTTPX traffic through a proxy server: httpx -proxy http://127.0.0.1:8080 -l urls.txt. This is useful for testing through corporate proxies, anonymizing scan origin, or routing through Burp Suite for manual analysis.

How do I install httpx on Kali Linux?

On Kali, run 'sudo apt update && sudo apt install httpx-toolkit'. Kali packages it as httpx-toolkit to avoid a name clash with an unrelated Python 'httpx' library, so the binary may be invoked as httpx-toolkit or httpx depending on your PATH. For the newest release use Go: 'go install -v github.com/projectdiscovery/httpx/cmd/httpx@latest'. See the full Kali tools list for related recon utilities.

Why does 'httpx' run the wrong tool on my system?

There are two unrelated tools named httpx: the ProjectDiscovery HTTP toolkit (Go) and a Python HTTP client library. If 'httpx' opens a Python tool, you installed the wrong one. On Kali use the httpx-toolkit package, or install the Go binary and make sure its path (~/go/bin) comes first in your PATH.

How do I probe both HTTP and HTTPS with httpx?

By default httpx probes common schemes automatically. To be explicit, use -ports to add ports (e.g., -ports 80,443,8080,8443) and httpx will test each host across them. Pipe a plain hostname list in and httpx resolves the working scheme and port for each live server.

What is the difference between httpx and curl?

curl makes one carefully controlled request at a time and is ideal for API testing and debugging a single endpoint. httpx is built for scale: it probes thousands of hosts concurrently, extracts titles, status codes, and technologies, and outputs structured JSON. Use curl to inspect one target, httpx to triage many. For port-level checks, pair either with Nmap.

How do I chain httpx with Nuclei?

Feed live URLs from httpx straight into Nuclei: 'subfinder -d target.com | httpx -silent | nuclei -t cves/'. httpx filters the list down to live web servers so Nuclei only scans real targets, which saves time and reduces noise against the target.

How do I speed up a large httpx scan?

Increase concurrency with -c (or -threads), raise -rate-limit carefully, and use -silent to cut console overhead. For very large lists, disable expensive features you do not need, such as -screenshot and -tech-detect, and add them back in a second pass against only the live hosts.

How do I fix 'context deadline exceeded' in httpx?

That warning means a host did not respond within the timeout. Raise it with -timeout 10, lower concurrency with -c so you are not overwhelming your own connection, and confirm the target is reachable using basic Linux commands like ping and curl. Slow or filtered hosts will always produce some timeouts.

Can httpx extract page titles and status codes together?

Yes. Combine flags: 'httpx -l hosts.txt -title -status-code -tech-detect'. This prints each live URL alongside its HTTP status, page title, and detected technologies in one pass, which is the most common triage command for narrowing a large host list to interesting targets.

How do I save httpx output for later analysis?

Use -o for plain text ('-o live.txt') or -json for structured output ('-json -o live.json'). JSON records the status code, title, technologies, and content length per host, which makes it easy to feed results into scripts, dashboards, or the next tool in your pipeline.

Is httpx safe to run against production targets?

httpx is active: it sends real requests to the target, so only run it against systems you own or are authorised to test. Keep concurrency and rate limits reasonable to avoid disrupting the service, follow the bug bounty program's rules of engagement, and practise first in the Terminal Sandbox.

How do I detect specific status codes or filter noise with httpx?

Match only the codes you care about with -mc (e.g., -mc 200,301) or filter out noise with -fc (e.g., -fc 404,403). You can also filter by content length with -fl and by response body with -fs, which is handy for stripping out identical error or parking pages.

Does httpx work on Windows and macOS?

Yes. httpx is a single cross-platform Go binary, so it runs on Windows, macOS, and Linux. Download the release for your OS from the ProjectDiscovery GitHub, or install with 'go install' if you have Go. The screenshot feature additionally needs Chromium or Chrome installed on that platform.

Tags

#reconnaissance#http-probe#live-host-detection#web-fingerprinting#bug-bounty#projectdiscovery#technology-detection#screenshot-capture#web-recon#automation

Ethical Usage Notice

This tool is designed for authorized security testing, educational purposes, and legitimate network administration only. Unauthorized access to computer systems is illegal.