Skip to content
#

adaptive-scraping

Star

Here is 1 public repository matching this topic...

anansi

mdowis / anansi

Star 100

A self-healing scraper for hostile sites: broken selectors repair themselves, browser rendering kicks in when needed, and a coherent identity layer (Chrome TLS fingerprints, matched personas, vendor-aware Cloudflare/Akamai/DataDome handling) works to slip past bot detection. Ships with an MCP server so any LLM can drive a full crawl by conversat…

python crawler mcp web-scraper web-scraping data-extraction anti-bot self-healing pydantic tls-fingerprint ai-agent llm-tools concurrent-processing stealth-browser mcp-server adaptive-scraping
  • Updated Jul 17, 2026
  • Python

Improve this page

Add a description, image, and links to the adaptive-scraping topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the adaptive-scraping topic, visit your repo's landing page and select "manage topics."

Learn more