Why I Built Reader: Open-source web scraping for LLMs

Reader is a new open-source web scraping tool designed for Large Language Models that simplifies extracting clean content from websites. The tool emerged from the creator's frustration with rebuilding scraping infrastructure across projects, where simple webpage reading would spiral into complex problems involving JavaScript rendering, anti-bot detection, and proxy management. Reader offers two core functions - scrape() for individual URLs and crawl() for entire websites - both returning clean markdown output ready for AI applications, with all the underlying complexity of stealth browsing, browser pools, and content extraction handled automatically.