Senior Data Engineer - ELT Pipelines & Cloud Cost Insights

AgileEngine, LLC.; Austin (TX); On-site; USD 140,000 - 180,000; Full time

Benefits offered by this job

Professional growth

Competitive USD-based compensation

A selection of exciting projects

Flextime

Job summary

AgileEngine, LLC. is seeking a Senior Data Engineer to design and maintain data pipelines and automation systems that power cloud cost visibility and performance insights for the Cloud Economics team.

You will build scalable ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services like Glue, Athena, and Aurora, alongside Snowflake, optimizing for performance, reliability, and cost efficiency.

Qualifications

• 4+ years of experience in Data Engineering roles.
• Experience building end-to-end ELT/ETL pipelines in cloud environments.
• Strong SQL and Python.
• Experience with orchestration tools such as dbt, Airflow, or Dagster.
• AWS data ecosystem experience including AWS Glue, Amazon Athena, and Amazon Aurora.
• Experience with Snowflake.
• Strong data modeling and large-scale data processing experience.
• Experience with CI/CD, version control, Infrastructure as Code (Terraform), and REST API integrations.
• Demonstrated ability to optimize data pipelines for performance and cost.
• Strong analytical skills with data validation, auditing, and troubleshooting production pipelines.

Responsibilities

• Design, build, and maintain the Cloud Economics team's data pipelines and automation systems.
• Build and maintain scalable data pipelines and datasets that power cloud cost visibility, attribution, and performance insights.
• Design and implement data models and ingestion frameworks to support large-scale telemetry and usage data.
• Develop tooling that enables cost-aware decision‑making across Product, Engineering, and Finance stakeholders.
• Optimize data systems for performance, reliability, and cost efficiency (query tuning, storage strategies, compute optimization).
• Partner with Engineering and Finance teams to support cost optimization initiatives and usage‑based insights.
• Ensure data quality, validation, and auditability across end‑to‑end data workflows.

Skills

SQL

Python

ELT/ETL pipelines

Cloud data engineering

Data modeling

Data validation

CI/CD

REST API integrations

Analytics mindset

Tools

dbt

Airflow

Dagster

Terraform

AWS Glue

Amazon Athena

Amazon Aurora

Snowflake

Job description

AgileEngine, LLC. is seeking a Senior Data Engineer to design and maintain data pipelines and automation systems that power cloud cost visibility and performance insights for the Cloud Economics team.

You will build scalable ELT/ETL workflows using Python, SQL, dbt, and Airflow across AWS services like Glue, Athena, and Aurora, alongside Snowflake, optimizing for performance, reliability, and cost efficiency.