Senior Data Engineer: Databricks AI Analytics Platform

EPAM Systems, Inc.; México; A distancia; MXN 600.000 - 900.000; Jornada completa

Descripción de la vacante

EPAM Systems, Inc. seeks a Senior Data Engineer to build an analytics platform with Databricks-based data products. You will lead design of ingestion, transformation, and end-to-end data products from raw data to governed datasets.

You will mentor engineers, drive standards, and collaborate with cross-functional teams to deliver scalable, AI-enabled data capabilities. Strong Spark/PySpark, SQL, and data governance are required.

Formación

• 3+ years of data engineering experience with modern data platforms.
• Strong leadership skills to drive engineering standards and mentor other engineers.
• Proven project delivery experience building enterprise analytics solutions end to end.
• Advanced Apache Spark and PySpark skills for large-scale processing.
• Strong SQL skills for transformation logic and analytics-ready datasets.
• Hands-on CI/CD and data engineering SDLC experience using Git-based workflows.
• Strong data governance skills covering security, quality, and operational controls.

Responsabilidades

• Design scalable data ingestion and transformation frameworks for analytics use cases.
• Build batch, near real-time, and streaming pipelines using Databricks and Apache Spark.
• Define Databricks best practices for Medallion layers, performance, and operations.
• Deliver end-to-end data products from raw ingestion through governed consumption layers.
• Develop trusted analytical datasets and semantic models for reporting and self-service.
• Implement data quality, lineage, monitoring, and observability across pipelines.
• Lead proof-of-concepts and evaluate new capabilities within the Databricks ecosystem.
• Coordinate with engineering and analytics stakeholders to align on delivery plans.
• Mentor engineers and promote consistent platform standards across teams.

Conocimientos

Data engineering

Leadership

Apache Spark

PySpark

SQL

CI/CD

Data governance

Herramientas

Databricks

Apache Spark

Descripción del empleo

EPAM Systems, Inc. seeks a Senior Data Engineer to build an analytics platform with Databricks-based data products. You will lead design of ingestion, transformation, and end-to-end data products from raw data to governed datasets.

You will mentor engineers, drive standards, and collaborate with cross-functional teams to deliver scalable, AI-enabled data capabilities. Strong Spark/PySpark, SQL, and data governance are required.