PyScrappy: A Self-Healing Python Scraper Built to Feed AI Agents Structured Web Data

Scraping data for an AI agent shouldn’t start with a pile of glue code. PyScrappy is a Python web-scraping toolkit and optional MCP server for builders who need web data in agent workflows. It helps you turn URLs into structured, LLM-ready data by extracting page content, then exporting results as Markdown, JSON, or DataFrames for the next step in your workflow. Key features: • Generic extraction – pulls text, links, images, tables, and metadata from a URL • MCP server – exposes scrapers as tools an AI agent can call • Flexible selectors – use CSS selectors or navigate HTML with CSS/XPath helpers • JavaScript rendering – optional Playwright support handles JavaScript-heavy pages • Adaptive selectors – can relocate remembered elements when a site’s markup changes It’s open-source (MIT license). 🔗 GitHub: https://lnkd.in/dSWD2i25

Scraping data for an AI agent shouldn't start with a pile of glue code.

PyScrappy is an open-source (MIT-licensed) Python web-scraping toolkit with an optional MCP server, built for developers who need clean web data inside agent workflows.

It turns URLs into structured, LLM-ready data by extracting page content, then exporting results as Markdown, JSON, or DataFrames for the next step in a pipeline