Senior Data Engineer Cloud Economics Pipelines Remote

AgileEngine; Blacksburg (SC); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Job summary

AgileEngine is seeking a Senior Data Engineer to design and maintain data pipelines that power cloud cost visibility and performance insights for the Cloud Economics team. You will build ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services like Glue, Athena, and Aurora with Snowflake.

You will collaborate with Engineering and Finance to optimize costs, ensure data quality, and deliver scalable, cost-efficient data platforms.

Qualifications

• 4+ years of experience in Data Engineering roles.
• ELT/ETL pipelines in cloud environments.
• Strong SQL and Python proficiency.
• Experience with orchestration tools such as dbt, Airflow, or Dagster.
• Experience with AWS data ecosystem including Glue, Athena, and Aurora.
• Experience with Snowflake.
• CI/CD, version control, and Infrastructure as Code (Terraform).
• Ability to optimize data pipelines for performance and cost.
• Upper-intermediate English level.

Responsibilities

• Design, build, and maintain data pipelines and automation systems.
• Build scalable datasets powering cloud cost visibility and attribution.
• Design data models and ingestion frameworks for large-scale telemetry data.
• Develop tooling for cost-aware decision-making across stakeholders.
• Optimize data systems for performance, reliability, and cost efficiency.
• Collaborate with Engineering and Finance on cost optimization initiatives.
• Ensure data quality, validation, and auditability across end-to-end workflows.

Skills

SQL

Python

CI/CD

Infrastructure as Code

REST APIs

Data modeling

Tools

dbt

Airflow

Dagster

AWS Glue

Amazon Athena

Amazon Aurora

Snowflake

Terraform

Job description

AgileEngine is seeking a Senior Data Engineer to design and maintain data pipelines that power cloud cost visibility and performance insights for the Cloud Economics team. You will build ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services like Glue, Athena, and Aurora with Snowflake.

You will collaborate with Engineering and Finance to optimize costs, ensure data quality, and deliver scalable, cost-efficient data platforms.