Senior Data Engineer

EPAM Systems, Inc.; México; A distancia; MXN 600.000 - 900.000; Jornada completa

Descripción de la vacante

EPAM Systems, Inc. seeks a Senior Data Engineer to build an analytics platform with Databricks-based data products. You will lead design of ingestion, transformation, and end-to-end data products from raw data to governed datasets.

You will mentor engineers, drive standards, and collaborate with cross-functional teams to deliver scalable, AI-enabled data capabilities. Strong Spark/PySpark, SQL, and data governance are required.

Formación

• 3+ years of data engineering experience with modern data platforms.
• Strong leadership skills to drive engineering standards and mentor other engineers.
• Proven project delivery experience building enterprise analytics solutions end to end.
• Advanced Apache Spark and PySpark skills for large-scale processing.
• Strong SQL skills for transformation logic and analytics-ready datasets.
• Hands-on CI/CD and data engineering SDLC experience using Git-based workflows.
• Strong data governance skills covering security, quality, and operational controls.

Responsabilidades

• Design scalable data ingestion and transformation frameworks for analytics use cases.
• Build batch, near real-time, and streaming pipelines using Databricks and Apache Spark.
• Define Databricks best practices for Medallion layers, performance, and operations.
• Deliver end-to-end data products from raw ingestion through governed consumption layers.
• Develop trusted analytical datasets and semantic models for reporting and self-service.
• Implement data quality, lineage, monitoring, and observability across pipelines.
• Lead proof-of-concepts and evaluate new capabilities within the Databricks ecosystem.
• Coordinate with engineering and analytics stakeholders to align on delivery plans.
• Mentor engineers and promote consistent platform standards across teams.

Conocimientos

Data engineering

Leadership

Apache Spark

PySpark

SQL

CI/CD

Data governance

Herramientas

Databricks

Apache Spark

Descripción del empleo

We are looking for a Senior Data Engineer to build and evolve a next-generation analytics platform with a strong focus on Databricks-based data products. You will combine hands-on delivery, technical leadership, and architecture to enable trusted, scalable, and AI-enabled data capabilities.ResponsibilitiesDesign scalable data ingestion and transformation frameworks for analytics use casesBuild batch, near real-time, and streaming pipelines using Databricks and Apache SparkDefine Databricks best practices for Medallion layers, performance, and operationsDeliver end-to-end data products from raw ingestion through governed consumption layersDevelop trusted analytical datasets and semantic models for reporting and self-serviceImplement data quality, lineage, monitoring, and observability across pipelinesLead proof-of-concepts and evaluate new capabilities within the Databricks ecosystemEnable AI-assisted engineering patterns and reusable accelerators for faster deliveryCoordinate with engineering and analytics stakeholders to align on delivery plansMentor engineers and promote consistent platform standards across teamsRequirements3+ years of data engineering experience with modern data platformsStrong leadership skills to drive engineering standards and mentor other engineersProven project delivery experience building enterprise analytics solutions end to endAdvanced Apache Spark and PySpark skills for large-scale processingAdvanced Databricks skills in production environments, including performance tuningStrong SQL skills for transformation logic and analytics-ready datasetsSolid data architecture knowledge, including Lakehouse and Medallion patternsHands-on CI/CD and data engineering SDLC experience using Git-based workflowsStrong data governance skills covering security, quality, and operational controlsExcellent communication skills to lead technical discussions with cross-functional teamsUpper-Intermediate English proficiency (B2) for effective collaborationNice to haveData Architecture experience designing scalable Lakehouse patternsData Solution Architecture experience translating business needs into platform designsScala experience for Spark-based pipeline developmentWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.