Senior Data Engineer - Lakehouse Platform & Pipelines

Arkham Technologies; Ciudad de México; Presencial; MXN 900.000 - 1.300.000; Jornada completa

Descripción de la vacante

Arkham Technologies in Mexico City seeks a Senior Data Engineer to own our high-performance data platform built on Lakehouse architecture. You will work with Apache Spark, Delta Lake, and Trino to ensure governance and interoperability across platforms.

You will shape the data infrastructure end-to-end, from ingestion to activation, building ingestion pipelines, orchestration, and catalog integration, while monitoring clusters with observability tools.

Formación

• 5+ years in data engineering, data architecture, or a related field.
• Proficiency in Apache Spark, Delta Lake, and Trino.
• Strong Python scripting/automation abilities.
• Hands-on AWS experience (Glue, S3, EMR).

Responsabilidades

• Lead the next phase of our Data Platform – Develop and enhance Arkham’s Data Platform, following Lakehouse architecture principles and ensuring data governance.
• Data Ingestion Pipelines – Design and implement pipelines to extract data from structured, semi-structured, and unstructured sources.
• Data Pipeline Orchestration – Create, monitor, and optimize multiple data extraction and transformation pipelines.
• Data Catalog Integration – Ensure interoperability between data catalogs and various query engines.
• Cluster Management & Observability – Oversee cluster performance and implement observability solutions to maintain optimal execution of data pipelines.

Conocimientos

Problem-Solving

Analytical skills

Herramientas

Apache Spark

Delta Lake

Trino

Python

AWS Glue

S3

EMR

Descripción del empleo

Arkham Technologies in Mexico City seeks a Senior Data Engineer to own our high-performance data platform built on Lakehouse architecture. You will work with Apache Spark, Delta Lake, and Trino to ensure governance and interoperability across platforms.

You will shape the data infrastructure end-to-end, from ingestion to activation, building ingestion pipelines, orchestration, and catalog integration, while monitoring clusters with observability tools.