Search Results: data-orchestration

Found 4 Skills

Data Processingdtsong/data-engineering-s...

streaming-data-skill

Use this skill when building real-time or near-real-time data pipelines. Covers Kafka, Flink, Spark Streaming, Snowpipe, BigQuery streaming, materialized views, and batch-vs-streaming decisions. Common phrases: "real-time pipeline", "Kafka consumer", "streaming vs batch", "low latency ingestion". Do NOT use for batch integration patterns (use integration-patterns-skill) or pipeline orchestration (use data-orchestration-skill).

🇺🇸|EnglishTranslated

Data Processingdagster-io/skills

dagster-integrations

Skill that helps users discover and understand Dagster integration libraries. Used when users have requests related to integrating with other tools / technologies, or when have users have questions related to specific integration libraries (dagster-*).

🇺🇸|EnglishTranslated

Data Processinglegout/data-platform-agen...

data-engineering-observability

Observability and monitoring for data pipelines using OpenTelemetry (traces) and Prometheus (metrics). Covers instrumentation, dashboards, and alerting.

🇺🇸|EnglishTranslated

Data Processingmajesticlabs-dev/majestic...

etl-patterns

Production ETL patterns orchestrator. Routes to core reliability patterns and incremental load strategies.

🇺🇸|EnglishTranslated