Senior Cloud Data Engineer – Cost & Performance Insights

AgileEngine, LLC.; West Palm Beach (FL); Hybrid; USD 120,000 - 190,000; Full time

Benefits offered by this job

Professional growth

Competitive USD compensation

Exciting projects with top-tier brands

Flextime: hybrid work from home and in

Job summary

AgileEngine, LLC. is seeking a Senior Data Engineer to design and maintain ELT/ETL data pipelines powering cloud cost visibility and performance insights for the Cloud Economics team. You will build scalable workflows in Python/SQL using dbt and Airflow across AWS services and Snowflake.

The role collaborates with Engineering and Finance stakeholders to enable cost optimization and usage-based decision making, ensuring data quality and auditable processes.

Qualifications

• Authorized to work for US employers without sponsorship.
• 4+ years of experience in Data Engineering roles.
• Strong foundation with end-to-end ELT/ETL pipelines in cloud environments.
• Strong SQL and Python.
• Experience with orchestration tools such as dbt, Airflow, or Dagster.
• AWS data ecosystem including Glue, Athena, Aurora.
• Experience with Snowflake.
• Strong data modeling and large-scale data processing experience.
• Experience with CI/CD, version control, Terraform, and REST API integrations.
• Ability to optimize data pipelines for performance and cost.
• Strong analytical skills with data validation and auditing.

Responsibilities

• Design, build, and maintain the Cloud Economics team's data pipelines and automation systems.
• Build and maintain scalable data pipelines and datasets powering cloud cost visibility and attribution.
• Design data models and ingestion frameworks for telemetry and usage data.
• Develop tooling for cost-aware decision-making across Product, Engineering, and Finance.
• Optimize data systems for performance, reliability, and cost efficiency.
• Partner with Engineering and Finance to support cost optimization initiatives.
• Ensure data quality, validation, and auditability across end-to-end workflows.

Skills

Data Engineering

ELT/ETL pipelines

SQL

Python

Data modeling

CI/CD

REST APIs

Tools

dbt

Airflow

Dagster

Terraform

Snowflake

AWS Glue

Amazon Athena

Amazon Aurora

Job description

AgileEngine, LLC. is seeking a Senior Data Engineer to design and maintain ELT/ETL data pipelines powering cloud cost visibility and performance insights for the Cloud Economics team. You will build scalable workflows in Python/SQL using dbt and Airflow across AWS services and Snowflake.

The role collaborates with Engineering and Finance stakeholders to enable cost optimization and usage-based decision making, ensuring data quality and auditable processes.