Data engineering practice patterns for data pipelines, ETL/ELT, orchestration, data quality, and infrastructure. Covers Airflow, Dagster, Prefect, Spark, dbt, data lakes, lakehouses, Iceberg, Delta Lake, warehouses (Snowflake, BigQuery, Databricks), streaming (Kafka, Kinesis, Flink), CDC, data contracts, data governance, data mesh, and batch processing. Use when reviewing or building data pipelines, ingestion systems, stream processing, data infrastructure, or data platform architecture. Do not…
Install data-engineering from the Agent Magic Skills Marketplace. Once installed, the skill is immediately available in your agent workspace. You can invoke it from chat, compositions, or any agent workflow.
Data engineering practice patterns for data pipelines, ETL/ELT, orchestration, data quality, and infrastructure. Covers Airflow, Dagster, Prefect, Spark, dbt, data lakes, lakehouses, Iceberg, Delta Lake, warehouses (Snowflake, BigQuery, Databricks), streaming (Kafka, Kinesis, Flink), CDC, data…
data-engineering provides AI and machine learning capabilities including various tools and integrations. It extends your agent with specialized AI features.
You can install data-engineering directly from the Agent Magic Skills Marketplace. Navigate to the skill page, click “Install”, and it will be available in your agent workspace immediately.