SMRTR AIJun 28, 2026Hacker News

AgentCrawl, a small self-hosted crawler for AI agents

SMRTR summary

AgentCrawl is a self-hosted, open-source crawler that helps AI agents read web pages cleanly by converting raw HTML into structured Markdown, links, and metadata. It runs via CLI, Python, Docker, or as an MCP server, keeping all cached data and crawl jobs stored locally rather than on third-party services.

SMRTR provides this summary for quick context. The original article belongs to Hacker News.

Read the original article
SMRTR AI

Get the next batch of curated summaries in your inbox.

This archive is built from SMRTR newsletter summaries. Subscribe for hand-picked stories without the extra noise.