web-research

Original：🇺🇸 English
Translated

Neural web search and content extraction using x402-protected APIs. Better than WebSearch for deep research and WebFetch for blocked sites. USE FOR: - Deep web research and investigation - Finding similar pages to a reference URL - Extracting clean text from web pages - Scraping sites that block standard fetchers - Getting direct answers to factual questions - Research requiring multiple sources TRIGGERS: - "research", "investigate", "deep dive", "find sources" - "similar to", "pages like", "more like this" - "scrape", "extract content from", "get the text from" - "blocked site", "can't access", "paywall" - "what is", "explain", "answer this" Use `npx agentcash fetch` for stableenrich.dev endpoints. Prefer Exa for semantic/neural search, Firecrawl for direct scraping.

9installs
Sourcemerit-systems/agentcash-skills
Added on

NPX Install

npx skill4agent add merit-systems/agentcash-skills web-research

Tags

Translated version includes tags in frontmatter
neural-web-searchcontent-extractionweb-scrapingexa-apifirecrawl-tool

SKILL.md Content

View Translation Comparison →

Web Research with x402 APIs

Access Exa (neural search) and Firecrawl (web scraping) through x402-protected endpoints.

Setup

See rules/getting-started.md for installation and wallet setup.

Quick Reference

TaskEndpointPriceBest For
Neural search
https://stableenrich.dev/api/exa/search
$0.01Semantic web search
Find similar
https://stableenrich.dev/api/exa/find-similar
$0.01Pages similar to a URL
Extract text
https://stableenrich.dev/api/exa/contents
$0.002Clean text from URLs
Direct answers
https://stableenrich.dev/api/exa/answer
$0.01Factual Q&A
Scrape page
https://stableenrich.dev/api/firecrawl/scrape
$0.0126Single page to markdown
Web search
https://stableenrich.dev/api/firecrawl/search
$0.0252Search with scraping

When to Use What

ScenarioTool
General web searchWebSearch (free) or Exa ($0.01)
Semantic/conceptual searchExa search
Find pages like XExa find-similar
Get clean text from URLExa contents
Scrape blocked/JS-heavy siteFirecrawl scrape
Search + scrape resultsFirecrawl search
Quick fact lookupExa answer
See rules/when-to-use.md for detailed guidance.

Exa Neural Search

Semantic search that understands meaning, not just keywords:
bash
npx agentcash fetch https://stableenrich.dev/api/exa/search -m POST -b '{
  "query": "startups building AI agents for customer support",
  "numResults": 10,
  "type": "neural"
}'
Options:
  • query
    - Search query (required)
  • numResults
    - Number of results (default: 10, max: 25)
  • type
    - "neural" (semantic) or "keyword" (traditional)
  • includeDomains
    - Only search these domains
  • excludeDomains
    - Skip these domains
  • startPublishedDate
    / 
    endPublishedDate
    - Date range filter
Returns: List of URLs with titles, snippets, and relevance scores.

Find Similar Pages

Find pages semantically similar to a reference URL:
bash
npx agentcash fetch https://stableenrich.dev/api/exa/find-similar -m POST -b '{
  "url": "https://example.com/article-i-like",
  "numResults": 10
}'
Great for:
  • Finding competitor products
  • Discovering related content
  • Expanding research sources

Extract Text Content

Get clean, structured text from URLs:
bash
npx agentcash fetch https://stableenrich.dev/api/exa/contents -m POST -b '{
  "urls": [
    "https://example.com/article1",
    "https://example.com/article2"
  ]
}'
Options:
  • urls
    - Array of URLs to extract
  • text
    - Include full text (default: true)
  • highlights
    - Include key highlights
Cheapest option ($0.002) when you already have URLs and just need the content.

Direct Answers

Get factual answers to questions:
bash
npx agentcash fetch https://stableenrich.dev/api/exa/answer -m POST -b '{"query": "What is the population of Tokyo?"}'
Returns a direct answer with source citations. Best for:
  • Factual questions
  • Quick lookups
  • Verification of claims

Firecrawl Scrape

Scrape a single page to clean markdown:
bash
npx agentcash fetch https://stableenrich.dev/api/firecrawl/scrape -m POST -b '{"url": "https://example.com/page-to-scrape"}'
Options:
  • url
    - Page to scrape (required)
  • formats
    - Output formats: ["markdown", "html", "links"]
  • onlyMainContent
    - Skip nav/footer/ads (default: true)
  • waitFor
    - Wait ms for JS to render
Advantages over WebFetch:
  • Handles JavaScript-rendered content
  • Bypasses common blocking
  • Extracts main content only
  • LLM-optimized markdown output

Firecrawl Search

Web search with automatic scraping of results:
bash
npx agentcash fetch https://stableenrich.dev/api/firecrawl/search -m POST -b '{
  "query": "best practices for react server components",
  "limit": 5
}'
Options:
  • query
    - Search query (required)
  • limit
    - Number of results (default: 5)
  • scrapeOptions
    - Options passed to scraper
Returns search results with full scraped content for each.

Workflows

Deep Research

  • (Optional) Check balance: 
    npx agentcash wallet info
  • Search broadly with Exa
  • Find related sources with find-similar
  • Extract content from top sources
  • Synthesize findings
bash
npx agentcash fetch https://stableenrich.dev/api/exa/search -m POST -b '{"query": "AI agents in healthcare 2024", "numResults": 15}'
bash
npx agentcash fetch https://stableenrich.dev/api/exa/find-similar -m POST -b '{"url": "https://best-article-found.com"}'
bash
npx agentcash fetch https://stableenrich.dev/api/exa/contents -m POST -b '{"urls": ["url1", "url2", "url3"]}'

Blocked Site Scraping

  • Try WebFetch first (free)
  • If blocked/empty, use Firecrawl with 
    waitFor
    for JS-heavy sites
bash
npx agentcash fetch https://stableenrich.dev/api/firecrawl/scrape -m POST -b '{"url": "https://blocked-site.com/article", "waitFor": 3000}'

Cost Optimization

  • Use Exa contents ($0.002) when you already have URLs
  • Use WebSearch/WebFetch first (free) and fall back to x402 endpoints
  • Batch URL extraction - pass multiple URLs to Exa contents
  • Limit results - request only as many as needed