Lead Data Software Engineer

EPAM Systems, Inc.; México; A distancia; MXN 900.000 - 1.300.000; Jornada completa

Descripción de la vacante

EPAM Systems, Inc. is seeking a Lead Data Software Engineer to join our global delivery teams in Mexico. You will lead hands-on data engineering work, shape data architectures, and drive delivery on critical projects with stakeholders and engineering teams.

In this role, you will develop and maintain ETL/ELT pipelines, leverage Spark, Databricks, and related technologies, and guide junior engineers through agile delivery processes. Excellent English communication is required.

Formación

• Minimum 5 years in a similar data engineering/lead role.
• At least 1 year leading and managing teams.
• Strong Python for data engineering.
• SQL proficiency for data querying.
• Hands-on Apache Spark experience for large-scale processing.
• Experience with Databricks for data tasks.
• Excellent English proficiency (B2+).

Responsabilidades

• Develop and preserve the codebase supporting ETL and ELT pipelines, plus batch, micro-batch, and streaming systems.
• Set up infrastructure to pull, transform, and load data from various sources using ADF, Spark, Kafka, or similar tech.
• Identify, plan, and roll out internal process improvements to increase scalability.
• Architect and release data services using Spring Boot, ReactJS, NoSQL, and related UI/API tools.
• Maintain governance across delivery management and production processes.
• Act as the key contact for delivery matters with senior leadership and stakeholders.
• Provide technical direction to ensure architecture remains solid and forward-thinking.
• Write user stories and acceptance criteria as part of agile/scrum processes.
• Coordinate work across disciplines to keep delivery progressing.
• Ensure delivery aligns with customer processes and methodologies.
• Establish a continuous delivery risk management framework.
• Monitor and enhance delivery productivity over time.
• Serve as a technical resource for Data Engineers.
• Oversee production support and deployment responsibilities.

Conocimientos

Python

SQL

Apache Spark

Databricks

Leadership

Agile/Scrum

English

Herramientas

Kafka

PySpark

Spark Streaming

Java

Scala

Anthropic Claude Code

Descripción del empleo

We are looking for a Lead Data Software Engineer to join our company. This position brings together hands-on technical work and leadership responsibility, offering the chance to shape data architecture while driving delivery on critical projects. You will work closely with stakeholders and engineering teams to make sure solutions stay reliable and scalable as demands evolve. If you enjoy pairing hands-on technical involvement with accountability for delivery success, this role could be a strong fit for you.ResponsibilitiesDevelop and preserve the codebase supporting ETL and ELT pipelines, together with large batch, micro-batch, and streaming systemsSet up the infrastructure required to pull, transform, and load data efficiently from a variety of sources using ADF, Spark, Kafka, or comparable technologiesIdentify, plan, and roll out internal process improvements, such as automating manual tasks, improving data delivery, and modifying infrastructure to increase scalabilityArchitect and release data services solutions using technologies such as Spring Boot, ReactJS, NoSQL, and other related UI and API toolsMaintain governance across delivery management and production processes, aligned with the chosen delivery modelAct as the key contact for delivery-related matters with senior leadership and stakeholders, covering escalations, upsells, and ramp-downsProvide technical direction throughout the delivery process, keeping the architecture solid and forward-thinking while ensuring implementation meets quality expectationsWrite user stories and their corresponding acceptance criteria as part of an agile/scrum processCoordinate work across multiple disciplines and stakeholders to keep delivery progressingEnsure project delivery aligns with customer processes and methodologies, applying strong knowledge of different delivery models with an agile-focused approachEstablish a continuous delivery risk management framework that enables proactive decision-making throughout the delivery lifecycleMonitor and enhance delivery productivity over timeServe as a technical resource for Data Engineers, helping ensure their work meets quality and timeliness standardsOversee production support and deployment responsibilitiesRequirementsA minimum of 5 years of experience in a similar positionAt least one year of experience leading and managing teamsSolid command of core Python for data engineering purposesProficient in SQL for querying and processing dataHands-on experience with Apache Spark for large-scale data processingFamiliarity with Anthropic Claude CodeExperience using Databricks for data engineering and analytics tasksExcellent English proficiency (B2 level or higher)Nice to haveExperience with Apache Kafka for managing streaming dataWorking knowledge of JavaHands-on experience with PySparkFamiliarity with ScalaExperience with Spark StreamingWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.