Lead Data Software Engineer

EPAM Systems Inc; México; A distancia; MXN 900.000 - 1.300.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Healthcare benefits

Global career opportunities

Learning & development programs

Paid time off

Descripción de la vacante

EPAM Systems Inc in Mexico is seeking a Lead Data Software Engineer to build robust data frameworks that drive critical organizational decisions. You will design scalable pipelines, ingest data from diverse sources, and deliver clean, well-tested code within an agile team.

The role emphasizes leadership, code reviews, and data quality, with exposure to Delta Lake, Unity Catalog, Lakeflow, and Databricks. Strong PySpark, Spark SQL, and English communication are essential.

Formación

• Minimum 5 years of hands-on data engineering experience.
• At least 1 year of leading development teams.
• Strong experience with large-scale data processing and modern data platforms.

Responsabilidades

• Design and assemble scalable data pipelines across platforms.
• Ingest data from multiple source systems with robust ETL/ELT processes.
• Deliver clean, tested code built on solid software engineering foundations.
• Collaborate with cross-functional teams to translate data requirements into solutions.
• Monitor pipeline performance and ensure reliability; participate in code reviews.
• Address data quality issues and drive improvements to data architectures and governance.
• Produce technical documentation for onboarding and knowledge transfer.

Conocimientos

PySpark

Spark SQL

Delta Lake

Unity Catalog

Lakeflow

Auto Loader

JDBC/CDC

Databricks

Git

pytest

Databricks certification

Descripción del empleo

We're growing our team and seeking a Lead Data Software Engineer to join us. This opportunity suits someone who finds fulfillment in building robust data frameworks that drive critical organizational decisions. You'll be embedded in a team that places high value on clean, rigorously tested code paired with disciplined engineering methods. If large-scale data challenges motivate you, this role offers significant room for professional development and impactful workResponsibilitiesDesign and assemble scalable data pipelines that support consistent, dependable data movement across various platformsConstruct and maintain ingestion processes that draw data from numerous distinct source systemsDeliver clean, efficient, rigorously tested code built on strong software engineering foundationsCollaborate with teams spanning different functions to grasp data requirements and translate them into functioning technical solutionsTrack the performance of data pipelines, intervening proactively to address problems and sustain overall system reliabilityTake part in code review activities to help uphold quality standards and distribute knowledge across the broader teamIdentify and resolve data quality issues to protect the accuracy and consistency of datasetsSupport ongoing improvements to data architecture approaches and engineering best practicesProduce documentation detailing technical processes and solutions, supporting knowledge transfer and onboarding of new team membersFunction within an agile setup, contributing to sprint planning and other regular team ritualsRequirementsA minimum of 5 years of applicable hands-on experienceAt least one year spent leading and overseeing development teamsStrong working knowledge of PySpark and Spark SQL for building and handling large-scale data processesExperience constructing and managing Lakeflow pipelines and Jobs to enable data orchestrationCapable in applying Auto Loader and JDBC/CDC ingestion techniques, including work with sources such as DB2 and SQL ServerSolid background with Delta Lake and Unity Catalog, supporting data storage and governance functionsBackground upholding data quality standards and conducting source reconciliation to guarantee reliable, accurate dataExperience crafting unit tests via pytest to verify code accuracy and dependabilityWorking familiarity with Git and Asset Bundles for overseeing version control and deployment processesUpper-intermediate English language skills or higher (B2)Nice to haveBackground involved in DataStage migration projectsExperience pulling data from Dynamics 365/DataversePossession of a Databricks certificationWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.