Senior Data Platform Engineer: Python, GCP & Orchestration

Confiz Limited; México; Teletrabalho; MXN 900 000 - 1 400 000; Tempo integral

Resumo da oferta

Confiz Limited in Mexico is seeking a Data Platform Engineer to design, develop, and maintain scalable data orchestration platforms using Python, GCP, Airflow, and Terraform. You will build self-service capabilities and integrate diverse data sources for batch and real-time processing.

The role emphasizes IaC, CI/CD, data governance, and data cataloging, with exposure to BigQuery, GCS, Dataproc Serverless, Kafka, and Kubernetes. Collaboration across engineering and business teams is essential.

Qualificações

• Bachelor's or Master's degree in Computer Science, Engineering, or equivalent practical experience.
• 5–7 years of professional experience in Data Engineering or related roles.
• Strong Python programming experience for automation, services, and CLI tools.
• Strong SQL skills, especially in BigQuery and modern cloud data environments.

Responsabilidades

• Design, evolve, and maintain scalable data orchestration platforms for ETL/ELT operations.
• Build self-service platform capabilities for engineers, data scientists, and analysts.
• Develop integrations with data sources/destinations (Kafka, GCS, BigQuery, Postgres, S3) for batch and real-time processing.
• Provision and manage cloud data infrastructure using Terraform with IaC pipelines.
• Build and orchestrate data pipelines using Airflow and Kubernetes.
• Develop platform tooling and CLIs using Python and CI/CD workflows.

Conhecimentos

Python

SQL

BigQuery

GCP

Airflow

Terraform

Kubernetes

Kafka

CI/CD

AI tooling

Formação académica

Bachelor's degree in CS/Engineering

Master's degree (preferred)

Ferramentas

BigQuery

GCS

Dataproc Serverless

Terraform

Airflow

Kubernetes

Kafka

Confluent Cloud

Looker LookML

Descrição da oferta de emprego

Confiz Limited in Mexico is seeking a Data Platform Engineer to design, develop, and maintain scalable data orchestration platforms using Python, GCP, Airflow, and Terraform. You will build self-service capabilities and integrate diverse data sources for batch and real-time processing.

The role emphasizes IaC, CI/CD, data governance, and data cataloging, with exposure to BigQuery, GCS, Dataproc Serverless, Kafka, and Kubernetes. Collaboration across engineering and business teams is essential.