Apify MCP

RAG Web Browser is an Apify Actor that provides web browsing functionality for AI agents and LLM applications, similar to the web browsing feature in ChatGPT. It accepts a search phrase or a URL, queries Google Search, then crawls web pages from the top search results, cleans the HTML, converts it to text or Markdown, and returns it back for processing by the LLM application. The extracted text can then be injected into prompts and retrieval augmented generation (RAG) pipelines, to provide your LLM application with up-to-date context from the web. It supports dynamic JavaScript-heavy websites using a headless browser, automatically bypasses anti-scraping protections using proxies and browser fingerprints, and offers flexible scraping with Browser mode for complex websites or Plain HTML mode for faster scraping. Output formats include Markdown, plain text, and HTML. It also supports OpenAPI and MCP for easy integration and is open source, so you can review and modify it. The Actor can be used in two ways: as a standard Actor by passing it an input object with the settings, or in the Standby mode by sending it an HTTP request. Standby mode is preferred for production applications because if the Actor is already running, it will return the results much faster and can handle multiple requests in parallel, utilizing computing resources more efficiently.