Loading...
Loading...
Extract structured data from 40+ websites including Amazon, LinkedIn, Instagram, TikTok, Facebook, YouTube, and more. Uses Bright Data's Web Data APIs with automatic polling. Returns clean JSON with product details, profiles, reviews, posts, and comments.
npx skill4agent add brightdata/skills data-feedsexport BRIGHTDATA_API_KEY="your-api-key"export BRIGHTDATA_POLLING_TIMEOUT=600 # Max seconds to wait (default: 600)bash scripts/datasets.sh <dataset_type> <url> [additional_params...]| Dataset | Command | Description |
|---|---|---|
| Amazon Product | | Product details, pricing, ratings |
| Amazon Reviews | | Customer reviews for a product |
| Amazon Search | | Search results |
| Walmart Product | | Product details from Walmart |
| Walmart Seller | | Seller information |
| eBay Product | | eBay listing details |
| Home Depot | | Home Depot product data |
| Zara | | Zara product details |
| Etsy | | Etsy listing data |
| Best Buy | | Best Buy product info |
| Dataset | Command | Description |
|---|---|---|
| LinkedIn Person | | Profile data (experience, skills) |
| LinkedIn Company | | Company page data |
| LinkedIn Jobs | | Job posting details |
| LinkedIn Posts | | Post content and engagement |
| LinkedIn Search | | Find people |
| Crunchbase | | Company funding, employees |
| ZoomInfo | | Company profile data |
| Dataset | Command | Description |
|---|---|---|
| Profiles | | Bio, followers, following |
| Posts | | Post details, likes, captions |
| Reels | | Reel data and metrics |
| Comments | | Post comments |
| Dataset | Command | Description |
|---|---|---|
| Posts | | Post content and reactions |
| Marketplace | | Listing details |
| Reviews | | Company reviews |
| Events | | Event details |
| Dataset | Command | Description |
|---|---|---|
| Profiles | | Creator profile data |
| Posts | | Video details and metrics |
| Shop | | TikTok Shop product data |
| Comments | | Video comments |
| Dataset | Command | Description |
|---|---|---|
| Profiles | | Channel data |
| Videos | | Video details and stats |
| Comments | | Video comments (default: 10) |
| Dataset | Command | Description |
|---|---|---|
| X (Twitter) | | Tweet data |
| Post and comment data |
| Dataset | Command | Description |
|---|---|---|
| Maps Reviews | | Business reviews (default: 3 days) |
| Shopping | | Product comparison data |
| Play Store | | App details and reviews |
| Dataset | Command | Description |
|---|---|---|
| Apple App Store | | iOS app data |
| Reuters News | | News article content |
| GitHub | | Repository file data |
| Yahoo Finance | | Stock and company data |
| Zillow | | Property listing details |
| Booking.com | | Hotel listing data |
bash scripts/datasets.sh linkedin_person_profile "https://www.linkedin.com/in/satyanadella/"bash scripts/datasets.sh amazon_product "https://www.amazon.com/dp/B09V3KXJPB"bash scripts/datasets.sh instagram_profiles "https://www.instagram.com/natgeo/"bash scripts/datasets.sh youtube_comments "https://www.youtube.com/watch?v=dQw4w9WgXcQ" 20bash scripts/datasets.sh amazon_product_search "wireless headphones" "https://www.amazon.com"{
"name": "Satya Nadella",
"headline": "Chairman and CEO at Microsoft",
"location": "Greater Seattle Area",
"connections": "500+",
"experience": [...],
"education": [...],
"skills": [...]
}bash scripts/fetch.sh <dataset_id> '<json_input>'bash scripts/fetch.sh gd_l1viktl72bvl7bjuj0 '{"url":"https://linkedin.com/in/someone"}'