AI Map is an AI-powered website mapping tool by Oxylabs AI Studio that uses natural language prompts to intelligently discover and extract relevant URLs from any website.
-
Updated
Apr 2, 2026
#
site-mapping
Here are 6 public repositories matching this topic...
Give AI agents bounded eyes on the public web: crawl, search, and normalize evidence without an unrestricted browser.
nodejs open-source crawler typescript mcp web-crawler web-scraping robots-txt developer-tools browser-automation ai-agents evidence structured-extraction cloudflare-workers ai-agent agent-tools site-mapping llm-ready-data ssrf-protection
-
Updated
Aug 24, 2026 - JavaScript
🕸️ Crawl any website into a queryable navigation + content graph and find the shortest click-path to any action — deterministic, no-LLM browser automation
python cli sitemap spa graph accessibility web-crawler aria knowledge-graph web-scraping cytoscape browser-automation path-finding ai-agents web-testing navigation-graph qa-automation llm-tools site-mapping
-
Updated
Jul 20, 2026 - Python
RoverCrawler is a single-file Python web crawler designed to explore websites and generate a tree-mapped representation of their structure.
python cross-platform web-crawler rate-limiting json-export interactive-cli link-discovery data-export reconnaissance cli-tool security-research tree-visualization educational-tool web-recon site-mapping website-structure domain-restricted controlled-crawling
-
Updated
Mar 24, 2026 - Python
CLI tool that explores websites with Playwright, captures full-page screenshots, and generates structured crawl reports.
nodejs cli screenshots automation typescript web-crawler chromium web-archiving browser-automation website-crawler page-capture manual-login playwright site-explorer site-mapping website-audit website-archiving full-page-screenshots website-snapshots crawl-reporting
-
Updated
Mar 30, 2026 - TypeScript
MCP server for Firecrawl Simple — a web scraping and site mapping tool enabling LLMs to access and process web content
-
Updated
Apr 8, 2025 - TypeScript
Improve this page
Add a description, image, and links to the site-mapping topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the site-mapping topic, visit your repo's landing page and select "manage topics."