Senior Data Engineer - Lakehouse Platform Lead

Arkham Technologies Inc.; Ciudad de México; Presencial; MXN 800.000 - 1.200.000; Jornada completa

Descripción de la vacante

A data and AI platform provider in Mexico City seeks a Senior Data Engineer to lead the development of its Data Platform. The ideal candidate will possess over 5 years of experience in data engineering, with strong proficiency in Apache Spark and AWS services. Responsibilities include designing data ingestion pipelines and overseeing data lifecycle management. Join a team focused on cutting-edge data solutions that help industry leaders optimize their operations and make data-driven decisions.

Formación

• 5+ years of experience in data engineering, data architecture, or a related field.
• Strong knowledge of Apache Spark, Delta Lake, and Trino.
• Experience with AWS services like Glue, S3, and EMR.

Responsabilidades

• Lead the development of Arkham’s Data Platform.
• Design and implement pipelines for data ingestion.
• Create and monitor data extraction and transformation pipelines.
• Oversee cluster performance for optimal data pipeline execution.
• Maintain high data quality across integration and transformation.

Conocimientos

Data pipeline design

Apache Spark proficiency

Data governance practices

Python programming

Cloud services (AWS)

Descripción del empleo

A data and AI platform provider in Mexico City seeks a Senior Data Engineer to lead the development of its Data Platform. The ideal candidate will possess over 5 years of experience in data engineering, with strong proficiency in Apache Spark and AWS services. Responsibilities include designing data ingestion pipelines and overseeing data lifecycle management. Join a team focused on cutting-edge data solutions that help industry leaders optimize their operations and make data-driven decisions.