Senior Data Engineer (Cloud Cost & Data Pipelines)

AgileEngine; Irving (IA); Hybrid; USD 140,000 - 180,000; Full time

Benefits offered by this job

Professional growth

Competitive USD-based compensation

A selection of exciting projects

Flextime

Job summary

AgileEngine is seeking a Senior Data Engineer to design and maintain data pipelines and automation systems powering cloud cost visibility and performance insights. You will build scalable ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services like Glue, Athena, and Aurora, with Snowflake for analytics, ensuring reliability and cost efficiency.

You will partner with Engineering and Finance to support cost optimization, implement data models, validate data quality, and drive

Qualifications

• 6+ years of experience in data engineering or related roles.
• Experience building end-to-end ELT/ETL pipelines in cloud environments.
• Strong SQL and Python proficiency.
• Experience with orchestration tools such as dbt, Airflow, or Dagster.
• Hands-on experience with AWS data services (Glue, Athena, Aurora).
• Experience with Snowflake data platform.
• Familiarity with CI/CD, version control, IaC (Terraform), and REST API integrations.
• Strong data modeling and large-scale data processing experience.
• Upper-intermediate English level.

Responsibilities

• Design, build, and maintain data pipelines and automation systems for Cloud Economics.
• Develop scalable datasets to enable cloud cost visibility and performance insights.
• Create data models and ingestion frameworks for telemetry data at scale.
• Build tooling to support cost-aware decisions across product, eng, and finance.
• Optimize data systems for performance, reliability, and cost.
• Collaborate with engineering and finance to drive cost optimization initiatives.
• Ensure data quality, validation, and auditability across end-to-end workflows.

Skills

SQL

Python

Data modeling

ELT/ETL pipelines

Cloud data engineering

Data validation & auditing

CI/CD

REST API integrations

Tools

dbt

Airflow

Dagster

AWS Glue

Amazon Athena

Amazon Aurora

Snowflake

Terraform

Job description

AgileEngine is seeking a Senior Data Engineer to design and maintain data pipelines and automation systems powering cloud cost visibility and performance insights. You will build scalable ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services like Glue, Athena, and Aurora, with Snowflake for analytics, ensuring reliability and cost efficiency.

You will partner with Engineering and Finance to support cost optimization, implement data models, validate data quality, and drive