#126292 - Data Engineer

Lifted (an Upwork Company); Colombia; Remote; COP 291,300,000 - 388,400,000; Full time

Benefits offered by this job

Remote work in LATAM

40 hours per week

Job summary

Lifted (an Upwork Company) is seeking a Data Engineer to design, build, and maintain scalable data pipelines and automation systems supporting cloud cost visibility and performance insights. You will work with large-scale telemetry, usage, and financial data to help Product, Engineering, and Finance teams make cost-aware decisions.

The ideal candidate has strong hands-on experience with cloud data engineering, AWS, Snowflake, production pipeline ownership, data quality, and performance

Qualifications

• Must have hands-on experience building end-to-end ELT/ETL pipelines in cloud environments.
• Strong SQL and Python skills are essential.
• Experience with dbt, Airflow, or Dagster in production environments.
• Hands-on AWS data services (Glue, Athena, Aurora) and Snowflake experience.

Responsibilities

• Design, build, and maintain end-to-end ELT/ETL pipelines in cloud environments.
• Create scalable datasets for cost visibility, usage, and performance insights.
• Model data and ingestion frameworks for large telemetry and usage data.
• Develop automation tools for cost-aware decision making across teams.
• Optimize pipelines for performance, reliability, and cost efficiency.
• Tune queries and improve storage/compute strategies.
• Integrate REST APIs and other data sources.
• Support CI/CD and Infrastructure as Code.
• Ensure data quality, validation, auditability, and consistency.
• Troubleshoot production pipelines and resolve data issues.
• Collaborate with Engineering and Finance on cloud cost optimization.

Skills

ELT/ETL pipelines

SQL

Python

Airflow

Tools

dbt

Dagster

Terraform

AWS Glue

Amazon Athena

Amazon Aurora

Snowflake

Job description

We are seeking a Data Engineer to design, build, and maintain scalable data pipelines, datasets, and automation systems that support cloud cost visibility, attribution, and performance insights. This role will work with large-scale telemetry, usage, and financial data to help Product, Engineering, and Finance stakeholders make informed, cost-aware decisions. The ideal candidate has strong hands-on experience with cloud data engineering, AWS, Snowflake, production pipeline ownership, data quality, and performance and cost optimization.

Key Responsibilities

• Design, build, and maintain reliable end-to-end ELT and ETL pipelines in cloud environments.
• Build scalable datasets that support cloud cost visibility, attribution, usage analysis, and performance insights.
• Design and implement data models and ingestion frameworks for large-scale telemetry and usage data.
• Develop automation and tooling that enable cost-aware decision-making across Product, Engineering, and Finance teams.
• Optimize data pipelines and systems for performance, reliability, and cost efficiency.
• Perform query tuning and improve storage and compute strategies.
• Build and maintain integrations with REST APIs and other data sources.
• Implement and support CI/CD processes and Infrastructure as Code.
• Ensure data quality, validation, auditability, and consistency across end-to-end data workflows.
• Monitor, troubleshoot, and resolve production pipeline failures, data inconsistencies, and performance issues.
• Partner with Engineering and Finance stakeholders on cloud cost optimization and usage-based insights.

Must-Have Skills

• Strong data engineering foundation with proven experience building and maintaining end-to-end ELT or ETL pipelines in cloud environments.
• Strong SQL and Python skills.
• Experience with data workflow and orchestration tools such as dbt, Airflow, or Dagster.
• Hands-on experience with the AWS data ecosystem, including AWS Glue, Amazon Athena, and Amazon Aurora.
• Experience with Snowflake.
• Strong data modeling experience.
• Experience processing data at scale.
• Experience with CI/CD and version control.
• Hands-on Infrastructure as Code experience using Terraform.
• Experience building or maintaining REST API integrations.
• Demonstrated ability to optimize data pipelines for performance and cost.
• Strong analytical and troubleshooting skills.
• Experience with data validation, auditing, and production pipeline support.
• Enterprise experience strongly preferred.

Nice-to-Have Skills

• Scala experience.
• FinOps Certified Practitioner or FinOps Certified Engineer certification.
• Experience with cloud cost optimization, tagging strategies, or cost-monitoring systems.
• Experience working across both AWS and GCP.
• Experience with Datadog.
• Background in data platform engineering or shared infrastructure engineering.

Required Tools & Platforms

• Python
• SQL
• AWS Glue
• Amazon Athena
• Amazon Aurora
• Snowflake
• dbt, Airflow, or Dagster
• Terraform
• CI/CD tooling
• Git or another version-control platform
• REST APIs

Location, Time & Engagement

• Remote contract opportunity.
• Candidates must be located in LATAM.
• Full-time allocation of approximately 40 hours per week.
• Candidates must be available to work a U.S.-based EST or CST schedule.
• Contract expected to continue through March 31, 2027.