Senior Data Platform Engineer | Python, GCP, Airflow & Terraform) Level III - Mexico Only

Confiz Limited; Monterrey; Hybrid; MXN 900,000 - 1,400,000; Full time

Benefits offered by this job

Fortune 500 client exposure

Dynamic data platform environment

Competitive compensation

Job summary

Confiz Limited LATAM seeks a Data Platform Engineer based in Mexico to design, develop, and maintain scalable data orchestration platforms using Python, GCP, Airflow, and Terraform. You will build self-service capabilities for engineers, data scientists, and analysts while integrating diverse data sources like Kafka, GCS, BigQuery, Postgres, and S3 for batch and real-time processing.

The role emphasizes IaC with Terraform, data governance and lineage, and CI/CD practices.

Qualifications

• Bachelor’s or Master’s degree in Computer Science or Engineering.
• 5–7 years of professional experience in Data Engineering or related software roles.
• Strong Python programming for automation and tooling.
• Strong SQL proficiency in cloud data environments (BigQuery).
• Hands-on experience designing and maintaining ETL/ELT pipelines and data architectures.
• Experience with modern data transformation frameworks such as dbt.
• Strong hands-on experience with GCP data technologies (BigQuery, GCS, Dataproc Serverless).
• IaC experience with Terraform for provisioning cloud data infra.
• Hands-on experience building data pipelines with Airflow.
• Kubernetes experience in data platforms or cloud environments.
• Experience with Kafka / Confluent Cloud.
• Familiar with data governance, metadata management, cataloging, and lineage.
• CI/CD and Git-based workflows (GitHub Actions).
• Experience with AI-assisted developer tooling.

Responsibilities

• Design scalable data orchestration platforms for ETL/ELT operations.
• Build self-service platform capabilities for engineers, data scientists, and analysts.
• Integrate data sources and destinations (Kafka, GCS, BigQuery, Postgres, S3) for batch and real-time.
• Provision cloud data infra with Terraform via IaC pipelines.
• Build pipelines with Airflow and Kubernetes.
• Develop platform tooling and CLIs using Python.
• Implement metadata management, data cataloging, governance, and lineage.
• Design scalable, resilient solutions for large data volumes.
• Apply CI/CD and Git-based workflows to delivery.
• Evaluate emerging big data and AI-assisted dev tools.
• Create and maintain technical and user documentation.

Skills

Python

SQL

GCP

Airflow

Terraform

Kubernetes

Kafka

Data Governance

CI/CD

AI Tools

Education

Bachelor's or Master's in CS/Engineering

Tools

BigQuery

GCS

Dataproc Serverless

dbt

Job description

IMPORTANT: This position is ONLY for candidates currently based in Mexico and legally authorized to work in Mexico. Applications from outside Mexico will be automatically REJECTED!

CONSULTFIZ LATAM, a fully owned subsidiary of Confiz LLC, is looking for a Data Platform Engineer with strong experience in Python, GCP, Airflow, and Terraform to design, develop, and maintain scalable data orchestration platforms and self-service solutions. The ideal candidate will have hands-on experience with ETL/ELT pipelines, cloud data infrastructure, data orchestration, streaming technologies, and Infrastructure as Code (IaC). This role is for a Fortune 500 client.

Responsibilities

• Design, evolve, and maintain scalable data orchestration platforms that simplify ETL/ELT operations and abstract the complexities of big data technologies.
• Build and maintain self-service platform capabilities for engineers, data scientists, and analysts.
• Develop and maintain integrations with diverse data sources and destinations, including Kafka, GCS, BigQuery, Postgres, and S3, supporting both batch and real-time processing.
• Provision and manage cloud data infrastructure using Terraform, leveraging automated and version-controlled Infrastructure as Code pipelines.
• Build, maintain, and orchestrate reliable data pipelines using Airflow and Kubernetes.
• Develop platform tooling, automation, services, and CLIs using Python.
• Build and operate metadata management, data cataloging, governance, and data-lineage capabilities to make enterprise data discoverable and trustworthy.
• Design scalable and resilient solutions capable of handling large data volumes, high velocity, and diverse data formats.
• Apply modern CI/CD and Git-based workflows to platform and data pipeline delivery.
• Evaluate and incorporate emerging big data, ETL, and AI-assisted development technologies where appropriate.
• Create and maintain comprehensive technical and user documentation for platform capabilities and workflows.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Engineering, or equivalent practical experience.
• 5–7 years of professional experience in Data Engineering, Data Platform Engineering, or related software engineering roles.
• Strong professional programming experience with Python, including building and maintaining automation, services, and/or command-line tools.
• Strong proficiency in SQL, particularly within modern cloud data environments such as BigQuery.
• Hands-on experience designing and maintaining ETL/ELT pipelines and a solid understanding of modern data pipeline architecture.
• Experience with modern data transformation frameworks such as dbt.
• Strong hands-on experience with Google Cloud Platform (GCP) data technologies, particularly BigQuery, GCS, and Dataproc Serverless.
• Strong experience with Infrastructure as Code (IaC), particularly Terraform, for provisioning and managing cloud data infrastructure.
• Hands-on experience building and orchestrating data pipelines using Apache Airflow.
• Experience working with Kubernetes in data platform or cloud environments.
• Experience with streaming and event-driven data technologies such as Kafka / Confluent Cloud.
• Working knowledge of data governance, metadata management, data cataloging, and data lineage concepts.
• Familiarity with CI/CD and Git-based development workflows, including tools such as GitHub Actions.
• Experience using AI-assisted developer tooling, including LLMs, Model Context Protocol (MCP), and/or copilot-style productivity tools.
• Excellent problem-solving and communication skills, with the ability to collaborate effectively across engineering and business teams.

Nice to Have

• Experience with AWS data and cloud technologies.
• Hands-on experience with metadata, data cataloging, or data-lineage platforms such as DataHub, Collibra, Amundsen, or similar tools.
• Experience with BI or semantic-layer technologies such as Looker / LookML.
• Experience with data quality, observability, SLOs, error budgets, and production/on-call operations for data platforms.
• Familiarity with distributed data processing frameworks such as Apache Spark.
• Experience with Java and/or Scala is a plus.

We have a global team of amazing individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast growth fintech, and multiple Silicon Valley startups.

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM) and ISO 14001:2015 (EMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.

People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves.

To know more about Confiz Limited, visit https://www.linkedin.com/company/confiz/