Lead Data Engineer - Databricks & AI Analytics

EPAM Systems, Inc.; México; A distancia; MXN 1.200.000 - 1.700.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Healthcare benefits

Paid time off

LinkedIn Learning access

Global career opportunities

Descripción de la vacante

EPAM Systems, Inc. seeks a Lead Data Engineer to build a next-generation analytics platform focused on Databricks and scalable data products.

You will blend hands-on delivery with technical leadership across ingestion, modeling, governance, and AI-enabled engineering practices. You will design scalable data ingestion and transformation pipelines, implement data quality and governance, and lead best practices for the Databricks ecosystem while mentoring engineers and guiding cross-functional

Formación

• 5+ years of data engineering experience.
• 1+ years of technical leadership experience guiding engineering standards and best practices.
• Strong platform delivery experience building enterprise analytics solutions end to end.
• Advanced Apache Spark and PySpark expertise for large-scale processing.
• Strong SQL skills for transformation, modeling, and analytics consumption.
• Solid CI/CD experience and Data Engineering SDLC best practices.
• Upper-Intermediate English proficiency (B2) for day-to-day collaboration.

Responsabilidades

• Design scalable data ingestion, transformation, and data product frameworks.
• Define Databricks best practices, including Medallion Architecture, optimization, governance, and standards.
• Build batch, near real-time, and streaming pipelines using Databricks capabilities.
• Deliver end-to-end data products supporting analytics across domains.
• Develop trusted datasets, semantic models, and governed consumption layers.
• Lead data governance, quality, lineage, and observability across pipelines.
• Mentor engineers and define AI SDLC practices to accelerate delivery.

Conocimientos

Leadership

Communication

English (B2)

Herramientas

Databricks

Apache Spark

PySpark

SQL

CI/CD

Descripción del empleo

EPAM Systems, Inc. seeks a Lead Data Engineer to build a next-generation analytics platform focused on Databricks and scalable data products.

You will blend hands-on delivery with technical leadership across ingestion, modeling, governance, and AI-enabled engineering practices. You will design scalable data ingestion and transformation pipelines, implement data quality and governance, and lead best practices for the Databricks ecosystem while mentoring engineers and guiding cross-functional