Senior Data Engineer: Spark & Cloud Pipelines

Nielseniq-; Ciudad de México; Presencial; MXN 900.000 - 1.500.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible working environment

Volunteer time off

Descripción de la vacante

NielsenIQ (NIQ) is seeking a Data Engineer in Mexico City to join a team building and optimizing large data pipelines using Spark, PySpark, Python, Databricks, Airflow, SQL, Docker and Kubernetes.

You will maintain and assemble data pipelines, apply complex transformations, integrate finished models, and document features for support teams, with a focus on scalable performance. Flexible environment and AI tooling are supported.

Formación

• Minimum 5-8 years of data engineering experience.
• Experience modeling or manipulating large data sets.
• Hands-on data engineer with Spark (Python/Scala) expertise.
• Knowledge of data warehousing concepts and SQL.
• CI/CD and DevSecOps experience is a plus; cloud certifications preferred.

Responsabilidades

• Maintain and assemble data pipelines processing large datasets.
• Perform complex data transformations to generate client insights.
• Integrate finished models into pipelines and build insights for customers.
• Optimize Spark code and build infrastructure for ETL using Azure, Databricks and SQL.
• Write and maintain feature documentation for L2 support.

Conocimientos

Spark

Python

Scala

Databricks

Airflow

SQL

Docker

Kubernetes

CI/CD

DevSecOps

AI tools

Cloud certs

Herramientas

Spark

Databricks

Airflow

SQL

Docker

Kubernetes

Azure

Descripción del empleo

NielsenIQ (NIQ) is seeking a Data Engineer in Mexico City to join a team building and optimizing large data pipelines using Spark, PySpark, Python, Databricks, Airflow, SQL, Docker and Kubernetes.

You will maintain and assemble data pipelines, apply complex transformations, integrate finished models, and document features for support teams, with a focus on scalable performance. Flexible environment and AI tooling are supported.