Loading...
Loading...
Compare original and translation side by side
data-architectontology-engineerdata-warehouse-engineerdata-scientistinfrastructure-engineertechnical-program-managerdata-architectontology-engineerdata-warehouse-engineerdata-scientistinfrastructure-engineertechnical-program-manager| Meeting | Frequency | Attendees | Purpose |
|---|---|---|---|
| Data Leadership Sync | Weekly | Data leads, PMs | Blockers, priorities, resource allocation |
| Stakeholder Reviews | Bi-weekly | Business sponsors | Roadmap alignment, value demonstration |
| Sprint Planning | Bi-weekly | Engineering team | Commitments, estimation, dependencies |
| Retrospectives | Monthly | Full data team | Process improvements, team health |
data-architect| 会议 | 频率 | 参会人员 | 目的 |
|---|---|---|---|
| 数据领导层同步会 | 每周 | 数据负责人、PM | 障碍排查、优先级确定、资源分配 |
| 利益相关方评审会 | 每两周 | 业务发起人 | 路线图对齐、价值展示 |
| 迭代规划会 | 每两周 | 工程团队 | 任务承诺、工作量估算、依赖项梳理 |
| 回顾会 | 每月 | 整个数据团队 | 流程改进、团队健康度评估 |
data-architect| Activity | Frequency | Owner | Output |
|---|---|---|---|
| Metadata stewardship | Continuous | Data stewards | Enriched catalog, documented lineage |
| Access reviews | Quarterly | Security + owners | Approved access matrix |
| Data lifecycle enforcement | Monthly | Operations | Archived/deleted per retention policy |
| Quality SLA review | Monthly | Governance lead | Quality scorecard, remediation plan |
| Policy compliance audit | Quarterly | Audit/compliance | Gap report, remediation tickets |
| 活动 | 频率 | 负责人 | 输出 |
|---|---|---|---|
| Metadata管理 | 持续进行 | 数据管理者 | 丰富的数据目录、文档化的数据血缘 |
| 访问评审 | 每季度 | 安全团队+数据所有者 | 批准的访问矩阵 |
| 数据生命周期执行 | 每月 | 运营团队 | 按保留策略归档/删除数据 |
| 质量SLA评审 | 每月 | 治理负责人 | 质量计分卡、整改计划 |
| 政策合规审计 | 每季度 | 审计/合规团队 | 差距报告、整改工单 |
| Layer | Metrics | Alert Threshold |
|---|---|---|
| Infrastructure | CPU, memory, disk, network | >80% for 5 min |
| Database | Connections, lock waits, replication lag | Replication lag >30s |
| Pipelines | Success rate, duration, row counts | <95% success rate |
| Data quality | Null rate, freshness, duplicates | SLA breach |
| Cost | Daily spend vs budget | >110% of daily budget |
| 层级 | 指标 | 告警阈值 |
|---|---|---|
| 基础设施 | CPU、内存、磁盘、网络 | 连续5分钟超过80% |
| 数据库 | 连接数、锁等待、复制延迟 | 复制延迟超过30秒 |
| 数据管道 | 成功率、时长、行数 | 成功率低于95% |
| 数据质量 | 空值率、新鲜度、重复率 | 违反SLA |
| 成本 | 每日支出vs预算 | 超过每日预算的110% |
| Category | Metric | Target | Measurement |
|---|---|---|---|
| Reliability | Pipeline success rate | >99% | Airflow/Dagster logs |
| Quality | Data quality score | >95% | dbt tests + Great Expectations |
| Freshness | Data latency (source → warehouse) | <4 hours | Pipeline metadata |
| Cost | Cost per TB processed | Trend down | Cloud billing |
| Productivity | Time from request to production | <2 weeks | Jira/Asana cycle time |
| Adoption | Active data consumers | Grow 10% QoQ | BI tool usage logs |
| Tier | Description | RTO | RPO | Example |
|---|---|---|---|---|
| Tier 1 | Business-critical dashboards | 1 hour | 0 | Revenue reporting |
| Tier 2 | Operational analytics | 4 hours | 4 hours | Marketing attribution |
| Tier 3 | Research/exploratory | 24 hours | 24 hours | Ad-hoc analysis |
| 类别 | 指标 | 目标 | 测量方式 |
|---|---|---|---|
| 可靠性 | 数据管道成功率 | >99% | Airflow/Dagster日志 |
| 质量 | 数据质量得分 | >95% | dbt测试 + Great Expectations |
| 新鲜度 | 数据延迟(源→仓库) | <4小时 | 数据管道metadata |
| 成本 | 每TB处理成本 | 呈下降趋势 | 云账单 |
| 生产力 | 从需求到生产的时间 | <2周 | Jira/Asana周期时间 |
| 使用率 | 活跃数据用户 | 每季度增长10% | BI工具使用日志 |
| 层级 | 描述 | RTO | RPO | 示例 |
|---|---|---|---|---|
| Tier 1 | 业务关键仪表盘 | 1小时 | 0 | 收入报表 |
| Tier 2 | 运营分析 | 4小时 | 4小时 | 营销归因 |
| Tier 3 | 研究/探索性分析 | 24小时 | 24小时 | 临时分析 |