unopim-data-transfer

Compare original and translation side by side

🇺🇸

Original

English
🇨🇳

Translation

Chinese

UnoPim Data Transfer

UnoPim 数据传输

The import/export pipeline uses a queued job system with state tracking.
导入/导出流水线采用带状态跟踪的队列任务系统。

When to Use This Skill

何时使用该技能

Invoke this skill when:
  • Configuring or running imports/exports
  • Debugging failed import/export jobs
  • Creating custom importer/exporter classes
  • Understanding the job pipeline
在以下场景调用该技能:
  • 配置或运行导入/导出任务
  • 调试失败的导入/导出任务
  • 创建自定义导入器/导出器类
  • 了解任务流水线机制

Job Pipeline

任务流水线

Import States

导入状态

PENDING → VALIDATED → PROCESSING → PROCESSED → LINKING → LINKED → INDEXING → INDEXED → COMPLETED
                                                                                        FAILED
PENDING → VALIDATED → PROCESSING → PROCESSED → LINKING → LINKED → INDEXING → INDEXED → COMPLETED
                                                                                        FAILED

Export States

导出状态

PENDING → PROCESSING → COMPLETED
                       FAILED
PENDING → PROCESSING → COMPLETED
                       FAILED

Import Architecture

导入架构

ClassPurpose
Helpers/Import.php
Import orchestrator — validates, batches, processes
Helpers/Importers/AbstractImporter.php
Base importer with batch processing
Helpers/Importers/Product/Importer.php
Product-specific import logic
Helpers/Importers/Category/Importer.php
Category-specific import logic
Helpers/Sources/CSV.php
CSV file reader
Helpers/Sources/Excel.php
Excel file reader
用途
Helpers/Import.php
导入协调器 — 负责验证、分批、处理
Helpers/Importers/AbstractImporter.php
带批次处理能力的基础导入器
Helpers/Importers/Product/Importer.php
商品专属导入逻辑
Helpers/Importers/Category/Importer.php
分类专属导入逻辑
Helpers/Sources/CSV.php
CSV 文件读取器
Helpers/Sources/Excel.php
Excel 文件读取器

Export Architecture

导出架构

ClassPurpose
Helpers/Export.php
Export orchestrator
Helpers/Exporters/AbstractExporter.php
Base exporter
Helpers/Exporters/Product/Exporter.php
Product export
Helpers/Exporters/Category/Exporter.php
Category export
用途
Helpers/Export.php
导出协调器
Helpers/Exporters/AbstractExporter.php
基础导出器
Helpers/Exporters/Product/Exporter.php
商品导出
Helpers/Exporters/Category/Exporter.php
分类导出

Queued Jobs

队列任务

StageJob Class
Import track
ImportTrackBatch
Import batch
ImportBatch
Link batch
LinkBatch
Linking
Linking
Index batch
IndexBatch
Indexing
Indexing
Completed
Completed
Export track
ExportTrackBatch
Export batch
ExportBatch
Upload
UploadFile
阶段任务类
导入追踪
ImportTrackBatch
导入批次
ImportBatch
关联批次
LinkBatch
关联处理
Linking
索引批次
IndexBatch
索引处理
Indexing
完成
Completed
导出追踪
ExportTrackBatch
导出批次
ExportBatch
上传
UploadFile

CLI Commands

CLI 命令

bash
undefined
bash
undefined

Start queue worker (required for import/export)

Start queue worker (required for import/export)

php artisan queue:work --queue="default,system"
php artisan queue:work --queue="default,system"

Run a specific job

Run a specific job

php artisan unopim:queue:work {jobId} {userEmail}
php artisan unopim:queue:work {jobId} {userEmail}

Restart workers after code changes

Restart workers after code changes

php artisan queue:restart
undefined
php artisan queue:restart
undefined

Models

模型

ModelPurpose
JobInstances
Job definition (type, entity, file path, settings)
JobTrack
Single job run (state, stats, errors)
JobTrackBatch
Individual batch within a job
模型用途
JobInstances
任务定义(类型、实体、文件路径、设置)
JobTrack
单次任务运行记录(状态、统计数据、错误)
JobTrackBatch
任务内的单个批次记录

Troubleshooting

问题排查

Import stuck in PENDING

导入卡在 PENDING 状态

Queue worker not running:
bash
php artisan queue:work --queue="default,system"
队列工作进程未运行:
bash
php artisan queue:work --queue="default,system"

Import fails with validation errors

导入因验证错误失败

Check
JobTrack.errors
for detailed row-level errors.
查看
JobTrack.errors
获取详细的行级错误信息。

Export produces empty file

导出生成空文件

Verify data exists and filters match records.
验证数据是否存在,且筛选条件匹配对应记录。

Creating Custom Importers/Exporters

创建自定义导入器/导出器

See the
unopim-plugin-dev
skill → custom-data-transfer.md.
查看
unopim-plugin-dev
技能 → custom-data-transfer.md