Data Platform Engineer: Scalable ETL Pipelines (GCP)

Confiz; Monterrey; On-site; MXN 900,000 - 1,500,000; Full time

Job summary

CONSULTFIZ LATAM, a Confiz subsidiary, seeks a Data Platform Engineer to design and maintain scalable data orchestration platforms. You will work with Python, GCP, Airflow, and Terraform to support ETL/ELT pipelines and data governance.

The role targets a Fortune 500 client and requires Mexico-based eligibility. Responsibilities include building self-service capabilities, integrating diverse data sources, and applying CI/CD practices in a cloud-native environment.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or equivalent practical experience.
• 5–7 years of professional experience in Data Engineering, Data Platform Engineering, or related software engineering roles.
• Proficient in Python and SQL, with experience building automation and data services.
• Experience in ETL/ELT pipelines and modern cloud data environments (BigQuery, GCS).
• Hands-on experience with Airflow, Terraform, Kubernetes, and IaC tooling.

Responsibilities

• Design, evolve, and maintain scalable data orchestration platforms for ETL/ELT operations.
• Build self-service platform capabilities for engineers, data scientists, and analysts.
• Develop integrations with data sources/destinations like Kafka, GCS, BigQuery, Postgres, and S3.
• Provision and manage cloud data infrastructure using Terraform and IaC practices.
• Build, maintain, and orchestrate data pipelines with Airflow and Kubernetes.
• Develop platform tooling, automation, and CLIs using Python.
• Implement metadata management, data cataloging, governance, and data lineage capabilities.
• Design scalable, resilient solutions for large data volumes and diverse formats.
• Apply CI/CD and Git-based workflows to platform and data pipelines.
• Explore emerging big data, ETL, and AI-assisted development technologies.
• Create comprehensive technical and user documentation.

Skills

Python

SQL

Airflow

Terraform

BigQuery

GCS

Dataproc Serverless

Kafka

Kubernetes

dbt

Looker

Looker/LookML

Data governance

CI/CD / GitHub Actions

AI-assisted tooling

AWS

Education

Bachelor’s or Master’s in Computer Science, Engineering

Tools

Looker/LookML

DataHub

Collibra

Amundsen

Kafka

Job description

CONSULTFIZ LATAM, a Confiz subsidiary, seeks a Data Platform Engineer to design and maintain scalable data orchestration platforms. You will work with Python, GCP, Airflow, and Terraform to support ETL/ELT pipelines and data governance.

The role targets a Fortune 500 client and requires Mexico-based eligibility. Responsibilities include building self-service capabilities, integrating diverse data sources, and applying CI/CD practices in a cloud-native environment.