Senior Data Engineer — Cloud Cost & Data Pipelines

AgileEngine; Atlanta (GA); On-site; USD 130,000 - 190,000; Full time

Benefits offered by this job

Professional growth

Competitive USD-based compensation

Flextime

Job summary

AgileEngine is seeking a Senior Data Engineer to design and maintain data pipelines that power cloud cost visibility and performance insights for a Cloud Economics team. You will build scalable ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services including Glue, Athena, and Aurora, alongside Snowflake, optimizing for performance and cost.

Collaborating with Engineering and Finance, you will ensure data quality, auditability, and cost-efficient data systems, enabling

Qualifications

• You must be authorized to work in the US with no visa sponsorship.
• 4+ years of experience in Data Engineering roles.
• End-to-end ELT/ETL pipelines in cloud environments.
• Strong SQL and Python fundamentals.
• Experience with orchestration tools (dbt, Airflow, Dagster).
• AWS data ecosystem (Glue, Athena, Aurora) and Snowflake experience.
• Strong data modeling and large-scale processing capabilities.
• CI/CD, version control, Terraform, and REST API integrations.

Responsibilities

• Design, build, and maintain the Cloud Economics data pipelines and automation systems.
• Create scalable data pipelines and datasets for cost visibility and attribution.
• Develop data models and ingestion frameworks for telemetry and usage data.
• Build tools enabling cost-aware decisions across stakeholders.
• Optimize pipelines for performance, reliability, and cost efficiency.
• Collaborate with Engineering and Finance to support cost optimization initiatives.
• Ensure data quality, validation, and auditability across end-to-end workflows.

Skills

Data pipeline design

ELT/ETL development

SQL

Python

dbt

Airflow

Dagster

AWS data services

Snowflake

CI/CD

Terraform

Tools

dbt

Airflow

Dagster

Terraform

Snowflake

AWS Glue

Amazon Athena

Amazon Aurora

Job description

AgileEngine is seeking a Senior Data Engineer to design and maintain data pipelines that power cloud cost visibility and performance insights for a Cloud Economics team. You will build scalable ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services including Glue, Athena, and Aurora, alongside Snowflake, optimizing for performance and cost.

Collaborating with Engineering and Finance, you will ensure data quality, auditability, and cost-efficient data systems, enabling