back to home

Best Open Source web scraping python Libraries

A curated list of the most popular GitHub repositories tagged with web scraping python. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.

#1scrapy/scrapy

Scrapy, a fast high-level web crawling & scraping framework for Python.

59,834Python
Analyze Code

#2seleniumbase/SeleniumBase

Python APIs for web automation, testing, and bypassing bot-detection with ease.

12,364Python
Analyze Code

#3D4Vinci/Scrapling

🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl!

9,101Python
Analyze Code