Senior Data Engineer — Cloud Cost & Data Pipelines

AgileEngine; Houston (TX); On-site; USD 120,000 - 190,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Job summary

AgileEngine is seeking a Senior Data Engineer to design and maintain data pipelines powering cloud cost visibility, attribution, and performance insights for a Cloud Economics team. You will build scalable ELT/ETL workflows across AWS services and Snowflake, optimizing for performance, reliability, and cost efficiency.

You will partner with Engineering and Finance to support cost optimization and usage-based decision-making, while ensuring data quality and end-to-end auditability.

Qualifications

• 4+ years of experience in data engineering and building end-to-end ELT/ETL pipelines.
• Strong SQL and Python foundations for data processing and modeling.
• Experience with cloud-based data ecosystems and orchestration tools (dbt, Airflow, Dagster).
• Exposure to AWS data services (Glue, Athena, Aurora) and Snowflake.
• Familiarity with data validation, auditing, and cost-aware data practices.

Responsibilities

• Design, build, and maintain the Cloud Economics data pipelines and automation systems.
• Develop scalable datasets powering cloud cost visibility, attribution, and performance insights.
• Create data models and ingestion frameworks for telemetry and usage data at scale.
• Build tooling to enable cost-aware decision-making across product, engineering, and finance teams.
• Optimize data systems for performance, reliability, and cost (tuning, storage, compute).
• Collaborate with Engineering and Finance to support cost optimization initiatives.
• Ensure data quality and auditability across end-to-end data workflows.

Skills

Data engineering

ELT/ETL pipelines

SQL

Python

Data modeling

Performance optimization

Data validation

Auditing

Troubleshooting

English proficiency

Tools

dbt

Airflow

Dagster

AWS Glue

Amazon Athena

Amazon Aurora

Snowflake

CI/CD

Terraform

REST API integrations

Job description

AgileEngine is seeking a Senior Data Engineer to design and maintain data pipelines powering cloud cost visibility, attribution, and performance insights for a Cloud Economics team. You will build scalable ELT/ETL workflows across AWS services and Snowflake, optimizing for performance, reliability, and cost efficiency.

You will partner with Engineering and Finance to support cost optimization and usage-based decision-making, while ensuring data quality and end-to-end auditability.