Senior Cloud Data Engineer — Cost & Analytics Pipelines

AgileEngine; Richmond (AL); Hybrid; USD 130,000 - 170,000; Full time

Benefits offered by this job

Professional growth

Competitive USD-based compensation

Exciting projects

Flextime

Job summary

AgileEngine is seeking a Senior Data Engineer to design and maintain data pipelines powering cloud cost visibility, attribution, and performance insights for a Cloud Economics team. You will build scalable ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services including Glue, Athena, and Aurora, alongside Snowflake, focusing on performance, reliability, and cost efficiency.

You will partner with Engineering and Finance to support cost optimization and usage-based

Qualifications

• 4+ years of experience in Data Engineering roles.
• Strong SQL and Python expertise.
• Experience building end-to-end ELT/ETL pipelines in cloud environments.
• Experience with orchestration tools (dbt, Airflow, Dagster).
• Proficiency with AWS data services (Glue, Athena, Aurora) and Snowflake.
• Knowledge of data modeling and large-scale data processing.
• Experience with CI/CD, version control, Infrastructure as Code (Terraform), and REST API integrations.

Responsibilities

• Design, build, and maintain the Cloud Economics team's data pipelines and automation systems.
• Develop scalable datasets powering cloud cost visibility, attribution, and performance insights.
• Design data models and ingestion frameworks for telemetry and usage data.
• Create tooling for cost-aware decisions across Product, Engineering, and Finance.
• Optimize data systems for performance, reliability, and cost efficiency.
• Collaborate with Engineering and Finance to support cost optimization initiatives and usage insights.
• Ensure data quality, validation, and auditability across end-to-end workflows.

Skills

4+ years data engineering

SQL

Python

ELT/ETL pipelines

data modeling

CI/CD

Terraform

REST API integrations

Tools

dbt

Airflow

Dagster

Snowflake

AWS Glue

Amazon Athena

Amazon Aurora

Datadog

Job description

AgileEngine is seeking a Senior Data Engineer to design and maintain data pipelines powering cloud cost visibility, attribution, and performance insights for a Cloud Economics team. You will build scalable ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services including Glue, Athena, and Aurora, alongside Snowflake, focusing on performance, reliability, and cost efficiency.

You will partner with Engineering and Finance to support cost optimization and usage-based