Back to Details

firecrawl-knowledge-ingest

Compare original and translation side by side

🇺🇸

Original

English
🇨🇳

Translation

Chinese

Firecrawl Knowledge Ingest

Firecrawl 知识库接入

Use this when a docs portal needs browser navigation, auth, pagination, or JS rendering.
当文档门户需要浏览器导航、身份验证、分页或JS渲染时，请使用此方案。

Onboarding Interview

入门沟通

Infer the portal URL, output format, auth needs, and page limit from context. If the portal is clear, proceed immediately.
Ask at most 1-3 concise questions only if blocked, such as the portal URL, whether authentication is required, or the desired output format.
从上下文推断门户URL、输出格式、身份验证需求和页面限制。若门户信息明确，可直接推进。
仅在受阻时提出最多1-3个简洁问题，例如门户URL、是否需要身份验证，或期望的输出格式。

Firecrawl Collection Plan

Firecrawl 采集方案

Use Firecrawl browser to:
  • open the portal and inspect navigation
  • identify sections, categories, sidebar links, and article URLs
  • follow sidebar navigation, next links, pagination, load-more controls, or search
  • scrape article content as markdown
  • extract metadata such as title, section, last updated date, author, and tags
Try Firecrawl map as a supplement for public URLs, but use browser navigation for auth-gated or JS-heavy content.
使用Firecrawl浏览器执行以下操作：
  • 打开门户并检查导航结构
  • 识别板块、分类、侧边栏链接和文章URL
  • 跟随侧边栏导航、下一页链接、分页控件、加载更多按钮或搜索结果
  • 以Markdown格式抓取文章内容
  • 提取元数据，如标题、板块、最后更新日期、作者和标签
对于公开URL，可尝试使用Firecrawl map作为补充，但针对需身份验证或依赖JS的内容，请使用浏览器导航。

Final Deliverable

最终交付物

markdown
undefined
markdown
undefined

Knowledge Ingest: [Portal]

知识库接入：[门户名称]

Summary

摘要

[Pages extracted, sections covered, limitations]
[提取的页面数量、覆盖的板块、限制说明]

Output

输出内容

[JSON/markdown/merged file path or content]
[JSON/Markdown/合并文件路径或内容]

Sections

板块列表

[Section names and article counts]
[板块名称及对应文章数量]

Failed Or Restricted Pages

失败或受限页面

[Any access/loading issues]
[任何访问/加载问题]

Sources

来源链接

[URLs extracted]
[提取的URL列表]

Rerun Inputs

重新运行参数

workflow: firecrawl-knowledge-ingest url: [portal url] format: [json/markdown/merged] max_pages: [number]
undefined
workflow: firecrawl-knowledge-ingest url: [门户URL] format: [json/markdown/merged] max_pages: [数字]
undefined

JSON Shape

JSON 结构

Use 
source
, 
url
, 
extractedAt
, 
totalArticles
, and 
sections[]
with article 
title
, 
url
, 
section
, 
content
, and 
metadata
.
需包含
source
、
url
、
extractedAt
、
totalArticles
字段，以及包含文章
title
、
url
、
section
、
content
和
metadata
的
sections[]
数组。

Quality Bar

质量标准

  • Preserve code examples, tables, and formatting.
  • Strip nav chrome, headers, and footers.
  • Track extraction progress and page failures.
  • Respect authentication boundaries.
  • 保留代码示例、表格和格式。
  • 移除导航栏、页眉和页脚。
  • 跟踪提取进度和页面失败情况。
  • 遵守身份验证边界。