Loading...
Loading...
Discover and list all URLs on a website without extracting content, via the Tavily CLI. Use this skill when the user wants to find a specific page on a large site, list all URLs, see the site structure, find where something is on a domain, or says "map the site", "find the URL for", "what pages are on", "list all pages", or "site structure". Faster than crawling — returns URLs only. Essential when you know the site but not the exact page. Combine with extract for targeted content retrieval.
npx skill4agent add tavily-ai/skills tavily-mapcurl -fsSL https://cli.tavily.com/install.sh | bash && tvly login# Discover all URLs
tvly map "https://docs.example.com" --json
# With natural language filtering
tvly map "https://docs.example.com" --instructions "Find API docs and guides" --json
# Filter by path
tvly map "https://example.com" --select-paths "/blog/.*" --limit 500 --json
# Deep map
tvly map "https://example.com" --max-depth 3 --limit 200 --json| Option | Description |
|---|---|
| Levels deep (1-5, default: 1) |
| Links per page (default: 20) |
| Max URLs to discover (default: 50) |
| Natural language guidance for URL filtering |
| Comma-separated regex patterns to include |
| Comma-separated regex patterns to exclude |
| Comma-separated regex for domains to include |
| Comma-separated regex for domains to exclude |
| Include external links |
| Max wait (10-150 seconds) |
| Save output to file |
| Structured JSON output |
mapextract# Step 1: Find the authentication docs
tvly map "https://docs.example.com" --instructions "authentication" --json
# Step 2: Extract the specific page you found
tvly extract "https://docs.example.com/api/authentication" --jsonextractcrawl--instructions