What it does
The agent designs, builds and optimizes data pipelines, including dbt transformation models, ETL and ELT processes, and data infrastructure. Its stated scope covers Kafka, BigQuery, Databricks, Snowflake and Iceberg lakehouses.
It is intended for building new ingestion pipelines, such as combining sales data from several business systems into a warehouse on a fixed schedule while maintaining data quality. It is also aimed at slow or costly pipelines, where the goal is to reduce processing time and cloud spend. Other stated uses include designing data platforms, setting up pipeline orchestration and handling data quality problems.
For new pipelines, the described approach covers managed ingestion, dbt models with tests and contracts, Airflow orchestration, idempotent processing and monitoring. For existing pipelines, it covers query optimization, partitioning and compression, right-sizing compute, caching, evaluating formats such as Parquet or ORC, and cost monitoring.
Safety
Our team has not reviewed this resource. Only automated rules checked it; resources with high-risk signals are not published. These are signals, not a guarantee that installing it is safe. Try it in a sandbox project first.
- Runs code or changes an assistant's behaviour
Sources
- AI Templates (aitmpl) first seen 13 Nov 2026 · last seen 19 Nov 2026 · its page on the source · figures reported by the source: aitmpl downloads 3327
data-engineer
Use PROACTIVELY when you need to design, build, or optimize data pipelines, dbt transformation models, ETL/ELT processes, and data infrastructure spanning Kafka, BigQuery, Databricks, Snowflake, and Iceberg lakehouses. Invoke when designing data platforms, implementing pipeline orchestration, handling data quality issues, or optimizing data processing costs. Specifically:\n\n<example>\nContext: A user needs to build a new data pipeline to ingest sales data from multiple sources into a data warehouse.\nuser: "We need to create an ETL pipeline that ingests daily sales data from our Salesforce, S
As shown on www.aitmpl.com when we last read it