Principal Data Platform Engineer — Scale ETL Pipelines

SmartRecruiters, Inc.; Ciudad de México; Híbrido; MXN 893.000 - 1.049.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible working environment

Volunteer time off

Descripción de la vacante

NIQ is seeking a Senior Data Platform Engineer for its Financial Services Engineering team. You will design, build, and optimize scalable data pipelines and automation to support alternative data for market research products.

You will collaborate with distributed teams, leverage Airflow, Spark, and Matillion, and contribute to data security and performance in a fast-paced environment.

Formación

• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• 7+ years of experience as a Data Engineer with ETL and data warehousing.
• 4+ years with Apache Airflow for data pipelines.
• Proficiency in Spark, Matillion, Python/Java; SQL and data modeling knowledge.

Responsabilidades

• Design, develop, and maintain robust data pipelines for multiple sources.
• Build automation tools for infrastructure provisioning and deployment.
• Collaborate with engineering to ensure high-availability data platforms.
• Orchestrate ETL workflows with Apache Airflow.
• Optimize pipelines for performance and data quality.
• Evaluate new technologies to improve data infrastructure.
• Drive data security and access-control policy implementations.
• Coordinate with DevOps for deployment and monitoring.

Conocimientos

Entrepreneurial spirit

Data enthusiasm

Ownership of deliverables

Analytical communication

Global collaboration

Teamwork in distributed teams

Ability to work under pressure

Educación

Bachelor's or Master's in CS/Data Engineering

Herramientas

Apache Airflow

Apache Spark

Matillion

Python/Java

Cloud platforms (AWS/GCP/Azure)

Descripción del empleo

NIQ is seeking a Senior Data Platform Engineer for its Financial Services Engineering team. You will design, build, and optimize scalable data pipelines and automation to support alternative data for market research products.

You will collaborate with distributed teams, leverage Airflow, Spark, and Matillion, and contribute to data security and performance in a fast-paced environment.