scraping-twitter-list-members

Compare original and translation side by side

🇺🇸

Original

English

🇨🇳

Translation

Chinese

Scraping Twitter List Members

抓取Twitter列表成员

Exports all member profiles from any public Twitter/X list. Useful for curated industry lists, competitor watchlists, or pre-built audiences.

导出任意公开Twitter/X列表中的所有成员资料。适用于精选行业列表、竞品监控列表或预建受众群体。

Prerequisites

前提条件

```
APIFY_TOKEN
```
environment variable set
Optional: Apify MCP server installed

已设置
```
APIFY_TOKEN
```
环境变量
可选：已安装Apify MCP服务器

Inputs

输入参数

Parameter	Type	Required	Default	Notes
`startUrls`	array	Optional	`[]`	Twitter list URLs (e.g. `https://x.com/i/lists/12345` )
`listIds`	array	Optional	`[]`	Twitter list IDs
`maxItems`	number	Optional	Unlimited	Maximum tweets to return
`customMapFunction`	string	Optional	—	JavaScript function to transform each output object

参数	类型	是否必填	默认值	说明
`startUrls`	数组	可选	`[]`	Twitter列表URL（例如 `https://x.com/i/lists/12345` ）
`listIds`	数组	可选	`[]`	Twitter列表ID
`maxItems`	数字	可选	无限制	返回的最大条目数
`customMapFunction`	字符串	可选	—	用于转换每个输出对象的JavaScript函数

Workflow

工作流程

Progress:
- [ ] Step 1: Validate list URL
- [ ] Step 2: Run twitter-list-scraper
- [ ] Step 3: Poll for SUCCEEDED
- [ ] Step 4: Deliver member dataset

进度：
- [ ] 步骤1：验证列表URL
- [ ] 步骤2：运行twitter-list-scraper
- [ ] 步骤3：轮询直到状态为SUCCEEDED
- [ ] 步骤4：交付成员数据集

Step 2: Run the Actor

步骤2：运行Actor

Recommended — run_actor.js (handles waiting, output, and file saving automatically):

bash

undefined

推荐方式 — run_actor.js（自动处理等待、输出和文件保存）：

bash

undefined

Quick answer (prints table to chat)

快速查看（在聊天中打印表格）

node scripts/run_actor.js
--actor "apidojo~twitter-list-scraper"
--input '{"param": "value"}'

Save as CSV

保存为CSV格式

node scripts/run_actor.js
--actor "apidojo~twitter-list-scraper"
--input '{"param": "value"}'
--output YYYY-MM-DD_results.csv --format csv

Save as JSON

保存为JSON格式

node scripts/run_actor.js
--actor "apidojo~twitter-list-scraper"
--input '{"param": "value"}'
--output YYYY-MM-DD_results.json --format json

> `APIFY_TOKEN` must be set in environment or `.env` file.

**If Apify MCP is available:**

Tool: apify:run-actor Actor: "apidojo~twitter-list-scraper" Input: { "listUrl": "https://twitter.com/i/lists/<LIST_ID>", "maxItems": 500 }


**REST API fallback:**
```bash
curl -X POST \
  "https://api.apify.com/v2/acts/apidojo~twitter-list-scraper/runs?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"listUrl": "https://twitter.com/i/lists/<LIST_ID>"}'

Save

id

RUN_ID

. Poll until

status = SUCCEEDED

bash

curl "https://api.apify.com/v2/actor-runs/$RUN_ID?token=$APIFY_TOKEN" | grep '"status"'

Fetch results:

bash

curl "https://api.apify.com/v2/actor-runs/$RUN_ID/dataset/items?token=$APIFY_TOKEN&format=json"

node scripts/run_actor.js
--actor "apidojo~twitter-list-scraper"
--input '{"param": "value"}'
--output YYYY-MM-DD_results.json --format json

> 必须在环境变量或`.env`文件中设置`APIFY_TOKEN`。

**如果Apify MCP可用：**

工具: apify:run-actor Actor: "apidojo~twitter-list-scraper" 输入: { "listUrl": "https://twitter.com/i/lists/<LIST_ID>", "maxItems": 500 }


**REST API备选方案：**
```bash
curl -X POST \
  "https://api.apify.com/v2/acts/apidojo~twitter-list-scraper/runs?token=$APIFY_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{"listUrl": "https://twitter.com/i/lists/<LIST_ID>"}'

保存

id

为

RUN_ID

。轮询直到

status = SUCCEEDED

：

bash

curl "https://api.apify.com/v2/actor-runs/$RUN_ID?token=$APIFY_TOKEN" | grep '"status"'

获取结果：

bash

curl "https://api.apify.com/v2/actor-runs/$RUN_ID/dataset/items?token=$APIFY_TOKEN&format=json"

Step 3: Handle Edge Cases

步骤3：处理边缘情况

Private list: Actor returns 0 results — inform user the list is not publicly accessible.
List deleted or moved: Validate URL returns 200 before running actor.
Very large lists (> 5000 members): May timeout — use
```
maxItems: 2000
```
and paginate.

私有列表：Actor返回0条结果——告知用户该列表无法公开访问。
列表已删除或迁移：在运行Actor前验证URL返回200状态码。
超大列表（成员数>5000）：可能超时——使用
```
maxItems: 2000
```
并分页处理。

Output Format

输出格式

undefined

undefined

Twitter List Members: <list name>

Twitter列表成员: <列表名称>

List URL: <url> | Members collected: N

Username	Display Name	Followers	Bio (truncated)	Location	Verified
...	...	...	...	...	...

undefined

列表URL: <url> | 已收集成员数: N

用户名	显示名称	粉丝数	简介（截断）	所在地	已认证
...	...	...	...	...	...

undefined

Troubleshooting

故障排除

0 results: List is private or URL is malformed. Verify the list is public. Partial results: Large lists may be rate-limited — retry with smaller

maxItems

0条结果：列表为私有或URL格式错误。请验证列表是否公开。 部分结果：超大列表可能受到速率限制——重试时设置更小的

maxItems

值。