Best Open Source web search Libraries

A curated list of the most popular GitHub repositories tagged with web search. Select any project to visualize its architecture and dive into the codebase using RepoMind's AI engine.

#1firecrawl/firecrawl

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

84,470TypeScript

Analyze Code

#2ScrapeGraphAI/Scrapegraph-ai

Python scraper based on AI

22,734Python

Analyze Code

#3InternLM/MindSearch

🔍 An LLM-based Multi-agent Framework of Web Search Engine (like Perplexity.ai Pro and SearchGPT)

6,768JavaScript

Analyze Code