monosans / proxy-scraper-checker
HTTP, SOCKS4, SOCKS5 proxies scraper and checker with rich functionality.
AI Architecture Analysis
This repository is indexed by RepoMind. By analyzing monosans/proxy-scraper-checker in our AI interface, you can instantly generate complete architecture diagrams, visualize control flows, and perform automated security audits across the entire codebase.
Our Agentic Context Augmented Generation (Agentic CAG) engine loads full source files into context on-demand, avoiding the fragmentation of traditional RAG systems. Ask questions about the architecture, dependencies, or specific features to see it in action.
Repository Overview (README excerpt)
Crawler viewš proxy-scraper-checker **A lightning-fast, feature-rich proxy scraper and checker built in Rust.** Collect, test, and organize HTTP/SOCKS4/SOCKS5 proxies from multiple sources with detailed metadata and intelligent filtering. ⨠Key Features ⢠**š„ Blazing Performance** - Rust-powered async engine with configurable concurrency ⢠**š Rich Metadata** - ASN, country/city geolocation, and response time data via offline MaxMind databases ⢠**šÆ Smart Parsing** - Advanced regex engine extracts proxies from any format ( ). Also supports CIDR notation (e.g. ), automatically expanding ranges into individual hosts. ⢠**š Auth Support** - Handles username/password authentication seamlessly ⢠**š Interactive TUI** - Real-time progress monitoring with beautiful terminal interface ⢠**ā” Flexible Output** - JSON (with metadata) and plain text formats ⢠**šļø Configurable** - Extensive options for sources, timeouts, and checking ⢠**š Local & Remote** - Supports both web URLs and local files as proxy sources ⢠**š³ Docker Ready** - Containerized deployment with volume mounting š Related Get pre-checked proxies from monosans/proxy-list - updated regularly using this tool. ā ļø SAFETY WARNING ā ļø This tool makes thousands of concurrent network requests to test proxies, which may trigger rate limiting or security flags from your ISP or network provider. Consider using a VPN to protect your IP reputation. š Quick Start > All configuration options are documented in with detailed comments explaining each setting. š» Binary Installation > **Note:** For Termux users, see the dedicated section below. ⢠**Download** the archive for your platform from nightly builds ⢠Look for artifacts starting with followed by your platform ⢠Not sure which platform? Check the platform support table ⢠**Extract** the archive to a dedicated folder ⢠**Configure** by editing to your needs ⢠**Run** the executable š³ Docker Installation > **Note:** Docker version outputs logs to stdout instead of the interactive TUI (terminal user interface). ⢠**Install** Docker Compose ⢠**Download** the archive from nightly builds ⢠Look for artifacts starting with followed by your CPU architecture ⢠**Extract** to a folder and configure ⢠**Build and run:** š± Termux Installation > **Important:** Download Termux from F-Droid, not Google Play (why?). ⢠**Install** with one command: ⢠**Configure** using a text editor: ⢠**Run the tool:** š Sponsors | | | | | ----------------------------------------------------------------------------------- | ---------------------------------------------------------------------------- | ---------------------------------------------------------------------------------------------------------------------------------------------------- | | **šØ Thordata.com** | Residential proxies ā get a full rebate on your first purchase (up to $900). | | š Support This Project Help this project grow and reach more developers: ⢠ā **Star the repository** ā Help others discover this tool ⢠š° **Sponsor via crypto** ā DM me on Telegram š License MIT _This product includes GeoLite2 Data created by MaxMind, available from https://www.maxmind.com_