Back to List
Notice:This resource is provided by a third-party author. Please review the code with AI tools or manually before use to ensure security and compatibility.
TypeScriptany4ai/AnyCrawl

AnyCrawl

AnyCrawl 🚀: A Node.js/TypeScript crawler that turns websites into LLM-ready data and extracts structured SERP results from Google/Bing/Baidu/etc. Native multi-threading for bulk processing.

86.4/100
3.4KForks: 359
View on GitHubHomepage →
Loading report...

Similar Projects

firecrawl

93

The API to search, scrape, and interact with the web at scale. 🔥

TypeScript155.6K

dify

95

Build Agentic workflows, RAG pipelines, with rich AI model and tool support on one collaborative workspace. Deploy on cloud, VPC, or self-hosted, so teams move from prototype to production without rebuilding the stack.

TypeScript150.1K

mem0

92

Universal memory layer for AI Agents

TypeScript61.6K

FastGPT

93

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

TypeScript29.1K
Back to List