Senior Data Engineer

AgileEngine; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

AgileEngine is seeking a Data Engineer to build data pipelines and tooling for cost attribution, optimization, and financial modeling. You will collaborate with product, engineering, analytics, and finance teams to deliver reliable, scalable data assets.

The role emphasizes hands-on development with SQL, Python, Spark, and Scala, plus dbt, Airflow, Dagster, and cloud platforms (AWS, GCP) and Snowflake. You’ll own end-to-end ELT pipelines, data modeling, and CI/CD practices.

Qualifications

• 4+ years of experience in Data Engineering.
• Hands-on experience with SQL, Python, Spark, and Scala.
• Hands-on experience with dbt, Airflow, and Dagster.
• Hands-on experience with AWS (Glue, Aurora, Athena), GCP, and Snowflake.
• Experience architecting ELT/ETL data pipelines, including data modeling and schema maturity.
• Exposure to CI/CD development, Infrastructure as Code (Terraform), and REST API programming.
• Strong attention to detail, analytical skills, and data auditing/validation.
• Ability to explain technical concepts to non-technical audiences.

Responsibilities

• Develop and implement tooling and datasets that drive telemetry-driven cost attribution and performance-informed financial modeling.
• Build and maintain data pipelines and tooling that provide cost transparency, surface optimization opportunities, and support committed use discount modeling and management.

Skills

SQL

Python

Spark

Scala

dbt

Airflow

Dagster

AWS

GCP

Snowflake

ELT/ETL

CI/CD

Terraform

REST APIs

Data Modeling

Datadog

Go

Tools

Datadog

Go

Job description

We are looking for a Data Engineer to build data pipelines and tooling for cost attribution, optimization, and financial modeling.

The mandatory requirements are 4+ years in Data Engineering, strong SQL, Python, Spark, and Scala skills, experience with dbt, Airflow, Dagster, AWS, GCP, and Snowflake, plus ELT/ETL, CI/CD, Terraform, and REST APIs. FinOps experience, Datadog, Go, and certification are a plus.

What you will do

• Develop and implement tooling and datasets that drive telemetry-driven cost attribution and performance-informed financial modeling, enabling product, engineering, analyst, and finance stakeholders to make faster, data-driven decisions and trust the data.
• Build and maintain data pipelines and tooling that provide cost transparency, surface optimization opportunities, and support committed use discount modeling and management.

Must haves

• 4+ years of experience in Data Engineering roles.
• Hands-on experience with SQL, Python, Spark, and Scala.
• Hands-on experience with workflow orchestration tools such as dbt, Airflow, and Dagster.
• Hands-on experience with AWS (Glue, Aurora, Athena), GCP, and Snowflake.
• Experience architecting and enhancing the long-term maintainability of end-to-end ELT/ETL data pipelines, including data modeling and schema maturity.
• Exposure to CI/CD development processes, Infrastructure as Code (Terraform), and REST API programming.
• Strong attention to detail, analytical skill, and comprehensive data auditing and end-to-end validation skills.
• Ability to explain technical concepts to non-technical audiences.

Nice to haves

• Experience with FinOps teams or cost optimization job duties.
• FinOps Practitioner or FinOps Engineer certification.
• Experience with Datadog API endpoints.
• Experience with Go.
• Growth without limits: build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
• Competitive compensation: get recognition that reflects your skills and impact, with regular performance and compensation reviews
• Flexibility: work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
• Meaningful, modern projects: build impactful products using modern technologies alongside global teams and leading brands
• Collaborative culture: join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
• Well-being & support: access local well-being programs and people-focused support tailored to your location