Senior FinOps Data Engineer

Upwork; Colombia; Remote; COP 477,449,000 - 604,768,000; Full time

Job summary

Upwork seeks a Senior FinOps Data Engineer to design, build, and maintain data ingestion, automation, and analytics platforms for cloud cost transparency and optimization. You will work with large-scale billing, usage, telemetry, and financial data to enable stakeholders to make data-driven decisions.

The role requires hands-on data engineering, production pipelines, and the ability to explain technical decisions to both technical and non-technical audiences.

Qualifications

• Hands-on experience with SQL, Python, Spark, and Scala.
• Hands-on workflow orchestration tools (dbt, Airflow, Dagster).
• AWS experience (Glue, Aurora, Athena) required.
• GCP and Snowflake experience strongly preferred.
• Experience building end-to-end ELT/ETL pipelines and data models.
• Data validation, auditing, and CI/CD with IaC (Terraform).
• REST API integration and data integration skills.
• Detail-oriented with ability to explain technical concepts clearly.

Responsibilities

• Design, build, and maintain end-to-end ELT/ETL pipelines in cloud environments.
• Develop datasets for cost attribution and financial modeling.
• Maintain pipelines enabling cloud cost transparency and optimization.
• Ingest and reconcile large-scale billing, usage, telemetry, and performance data.
• Design data models and ingestion frameworks for reliable reporting.
• Improve maintainability, scalability, observability, and reliability of workflows.
• Implement data auditing, validation, reconciliation, and quality controls.
• Build REST API integrations and automate infrastructure with Terraform.
• Support CI/CD processes and handle production pipeline troubleshooting.
• Collaborate with Product, Engineering, Analytics, and Finance to deliver insights.

Skills

SQL

Python

Spark

Scala

Airflow

dbt

Dagster

AWS

GCP

Snowflake

Terraform

REST APIs

CI/CD

Tools

AWS Glue

Amazon Aurora

Amazon Athena

Datadog API

Go

Job description

We are seeking a Senior FinOps Data Engineer to design, build, and maintain the data ingestion, automation, and analytical platforms that support cloud cost transparency, attribution, and optimization.

This role will work with large-scale billing, usage, telemetry, performance, and financial data. The work will enable Product, Engineering, Analytics, and Finance stakeholders to make faster, data-driven decisions and trust the underlying data. The ideal candidate is a current, hands-on data engineer who can build production data pipelines and cost-focused data products, improve their long-term maintainability, and clearly explain their technical decisions to both technical and non-technical audiences.

Key Responsibilities

• - Design, build, and maintain reliable end-to-end ELT and ETL pipelines in cloud environments.
• - Develop tooling and datasets for telemetry-driven cost attribution and performance-informed financial modeling.
• - Build and maintain pipelines and automation that provide cloud cost transparency, identify optimization opportunities, and support committed-use discount modeling and management.
• - Ingest and reconcile large-scale billing, usage, telemetry, and performance data from cloud platforms, APIs, and other sources.
• - Design and mature data models, schemas, and ingestion frameworks that support reliable downstream analysis and reporting.
• - Improve the maintainability, scalability, observability, and reliability of production data workflows.
• - Implement comprehensive data auditing, validation, reconciliation, and end-to-end quality controls.
• - Build and maintain REST API integrations and infrastructure automation.
• - Support CI/CD development processes and Infrastructure as Code using Terraform.
• - Troubleshoot production pipeline failures, data inconsistencies, and performance issues.
• - Partner with Product, Engineering, Analytics, and Finance stakeholders to translate technical data into clear, actionable insights.

Qualifications

Must-Have Skills

• - Hands-on experience with SQL, Python, Spark, and Scala.
• - Hands-on experience with workflow orchestration tools such as dbt, Airflow, and Dagster.
• - Hands-on AWS experience, including AWS Glue, Amazon Aurora, and Amazon Athena. AWS experience is required.
• - Hands-on experience with GCP and Snowflake.
• - Experience architecting and improving the long-term maintainability of end-to-end ELT and ETL data pipelines.
• - Experience processing, validating, and auditing data at scale.
• - Exposure to CI/CD development processes and version control.
• - Infrastructure as Code experience using Terraform.
• - REST API programming and data-integration experience.
• - Strong attention to detail, analytical ability, and production troubleshooting skills.
• - Ability to explain technical concepts and personally delivered work clearly to non-technical audiences.

Nice-to-Have Skills

• - Experience working with FinOps teams or performing cloud cost-optimization duties.
• - FinOps Certified Practitioner or FinOps Certified Engineer certification.
• - Experience working with Datadog API endpoints.
• - Experience with Go.

Additional information

Required Tools and Platforms

• - SQL
• - Python
• - Spark
• - Scala
• - AWS Glue
• - Amazon Aurora
• - Amazon Athena
• - GCP
• - Snowflake
• - dbt, Airflow, and/or Dagster
• - Terraform
• - CI/CD tooling
• - Git or another version-control platform
• - REST APIs

Location, Schedule, and Engagement

• - Remote contract opportunity.
• - Candidates must be located in LATAM.
• - Full-time allocation of approximately 40 hours per week.
• - Candidates must be available to work a U.S.-based EST or CST schedule.
• - The contract is expected to continue through March 31, 2027.