Senior Data Engineer - Lakehouse Platform Lead

Arkham Technologies Inc.; Ciudad de México; On-site; MXN 800,000 - 1,200,000; Full time

Job summary

A data and AI platform provider in Mexico City seeks a Senior Data Engineer to lead the development of its Data Platform. The ideal candidate will possess over 5 years of experience in data engineering, with strong proficiency in Apache Spark and AWS services. Responsibilities include designing data ingestion pipelines and overseeing data lifecycle management. Join a team focused on cutting-edge data solutions that help industry leaders optimize their operations and make data-driven decisions.

Qualifications

• 5+ years of experience in data engineering, data architecture, or a related field.
• Strong knowledge of Apache Spark, Delta Lake, and Trino.
• Experience with AWS services like Glue, S3, and EMR.

Responsibilities

• Lead the development of Arkham’s Data Platform.
• Design and implement pipelines for data ingestion.
• Create and monitor data extraction and transformation pipelines.
• Oversee cluster performance for optimal data pipeline execution.
• Maintain high data quality across integration and transformation.

Skills

Data pipeline design

Apache Spark proficiency

Data governance practices

Python programming

Cloud services (AWS)

Job description

A data and AI platform provider in Mexico City seeks a Senior Data Engineer to lead the development of its Data Platform. The ideal candidate will possess over 5 years of experience in data engineering, with strong proficiency in Apache Spark and AWS services. Responsibilities include designing data ingestion pipelines and overseeing data lifecycle management. Join a team focused on cutting-edge data solutions that help industry leaders optimize their operations and make data-driven decisions.