Senior Data Engineer - Cloud Economics & Cost Optimization

AgileEngine

New York (NY)

Hybrid

USD 120,000 - 180,000

Full time

9 days ago

Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Benefits offered by this job

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Job summary

AgileEngine is an Inc. 5000 company delivering software for Fortune 500 brands and startups. We are seeking a Senior Data Engineer to design and maintain data pipelines that power cloud cost visibility and performance insights for our Cloud Economics team.

You will build ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS (Glue, Athena, Aurora) and Snowflake, optimizing for reliability and cost efficiency.

Qualifications

4+ years of experience in Data Engineering roles.
ELT/ETL pipelines in cloud environments.
SQL and Python.
Experience with orchestration tools such as dbt, Airflow, or Dagster.
AWS data ecosystem experience, including AWS Glue, Amazon Athena, and Amazon Aurora.
Experience with Snowflake.
Strong data modeling and large-scale data processing experience.
CI/CD, version control, Infrastructure as Code (Terraform), and REST API integrations.
Demonstrated ability to optimize data pipelines for performance and cost.
Upper-intermediate English level.

Responsibilities

Design, build, and maintain the Cloud Economics team's data pipelines and automation systems.
Build and maintain scalable data pipelines and datasets that power cloud cost visibility, attribution, and performance insights.
Design and implement data models and ingestion frameworks to support large-scale telemetry and usage data.
Develop tooling that enables cost-aware decision-making across Product, Engineering, and Finance stakeholders.
Optimize data systems for performance, reliability, and cost efficiency (query tuning, storage strategies, compute optimization).
Partner with Engineering and Finance teams to support cost optimization initiatives and usage-based insights.
Ensure data quality, validation, and auditability across end-to-end data workflows.

Skills

Data pipeline design

Python

SQL

Airflow

dbt

Dagster

Snowflake

AWS Glue

Amazon Athena

Amazon Aurora

Cost optimization

English communication

Tools

dbt

Airflow

Dagster

Terraform

AWS

Snowflake

Job description

You will build ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS (Glue, Athena, Aurora) and Snowflake, optimizing for reliability and cost efficiency.

Get your free, confidential resume review.

or drag and drop your file here.