Senior Cloud Data Engineer - Cost & Performance Insights

AgileEngine; Dallas (TX); Hybrid; USD 140,000 - 170,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Job summary

AgileEngine seeks a Senior Data Engineer to design and maintain data pipelines powering cloud cost visibility and performance insights for the Cloud Economics team. Build scalable ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services including Glue, Athena, and Aurora, alongside Snowflake.

You will collaborate with Engineering and Finance to optimize costs and enable usage-based decision-making, focusing on performance, reliability, and auditability of end-to-end data

Qualifications

• Proven ability to design and maintain end-to-end data pipelines in cloud environments.
• Strong SQL and Python programming skills.
• Experience with orchestration tools (dbt, Airflow, Dagster).
• AWS data ecosystem (Glue, Athena, Aurora) experience.
• Snowflake data platform experience.
• CI/CD, version control, IaC (Terraform), and REST API integrations.

Responsibilities

• Design, build, and maintain the Cloud Economics team's data pipelines and automation systems.
• Build and maintain scalable data pipelines and datasets powering cost visibility and performance insights.
• Design data models and ingestion frameworks for large-scale telemetry and usage data.
• Develop tooling enabling cost-aware decision-making across product, engineering, and finance.
• Optimize data systems for performance, reliability, and cost efficiency.
• Partner with engineering and finance to support cost optimization initiatives.
• Ensure data quality, validation, and auditability across end-to-end workflows.

Skills

SQL

Python

ELT/ETL pipelines

dbt

Airflow

Dagster

AWS Glue

Amazon Athena

Amazon Aurora

Snowflake

CI/CD

Terraform

REST API integrations

Data modeling

Data validation

Auditability

English (Upper-intermediate)

Tools

Dagster

Job description

AgileEngine seeks a Senior Data Engineer to design and maintain data pipelines powering cloud cost visibility and performance insights for the Cloud Economics team. Build scalable ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services including Glue, Athena, and Aurora, alongside Snowflake.

You will collaborate with Engineering and Finance to optimize costs and enable usage-based decision-making, focusing on performance, reliability, and auditability of end-to-end data