Senior Data Engineer: Spark, Python & Azure Pipelines

NielsenIQ; Ciudad de México; Presencial; MXN 600.000 - 1.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible working environment

Volunteer time off

LinkedIn Learning

Employee-Assistance-Program (EAP)

Descripción de la vacante

NielsenIQ is seeking a Data Engineer in Mexico City to join a team building scalable data pipelines and analytics. The role focuses on large-scale data processing, model integration, and performance-optimized Spark code in Python/Scala, with exposure to Databricks, Fabric, and Airflow.

The successful candidate will design robust ETL infrastructure, collaborate across teams, and contribute to data warehousing strategies while maintaining clear technical documentation.

Formación

• Minimum 5-8 years of experience as a Data Engineer.
• Experience modeling or manipulating large datasets.
• Hands-on experience as a data engineer.
• Proficient with the Spark framework (Python/Scala).
• Knowledge of data warehousing concepts is a plus.
• Programming in Python/Scala and SQL is required.
• Experience building data pipelines with Spark (Databricks/Fabric) and Airflow.
• CI/CD & DevSecOps experience is a plus.
• Retail industry experience is a plus.
• Cloud certification for Data Engineer is preferred.

Responsabilidades

• Maintain and assemble data pipelines that ingest large datasets, performing complex transformations to generate client-facing facts.
• Integrate finished models into pipelines to build actionable client insights.
• Use Spark to optimize code, including data science models.
• Build infrastructure for ETL from diverse data sources using Azure, Databricks and SQL tech.
• Write and maintain feature documentation and transition features to L2 support.

Conocimientos

Data Engineering Experience

Spark (Python/Scala)

Python

SQL

Data Modeling

CI/CD / DevSecOps

Team Collaboration

AI tools exposure

Cloud Certification

Retail domain knowledge

Herramientas

Databricks

Fabric

Airflow

Azure

Descripción del empleo

NielsenIQ is seeking a Data Engineer in Mexico City to join a team building scalable data pipelines and analytics. The role focuses on large-scale data processing, model integration, and performance-optimized Spark code in Python/Scala, with exposure to Databricks, Fabric, and Airflow.

The successful candidate will design robust ETL infrastructure, collaborate across teams, and contribute to data warehousing strategies while maintaining clear technical documentation.