Lead Data Software Engineer

EPAM Systems, Inc.; Colombia; A distancia; COP 120.000.000 - 180.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Healthcare benefits

Paid time off

LinkedIn Learning access

Global career opportunities

Descripción de la vacante

EPAM Systems, Inc. in Colombia seeks a Lead Data Software Engineer to blend hands-on data engineering with leadership, shaping data architecture and delivery on critical projects.

You will architect data services with Spring Boot, ReactJS, NoSQL, and related UI/API tools, guide cross-functional teams, and drive governance and Agile practices to ensure scalable, reliable data solutions.

Formación

• 5+ years in a similar data eng/lead role.
• Strong Python for data engineering.
• Solid SQL for data processing.

Responsabilidades

• Develop and preserve codebase for ETL/ELT pipelines and streaming systems.
• Set up data pull/transform/load infrastructure using ADF, Spark, Kafka.
• Identify and roll out internal process improvements for scalability.
• Architect and release data services using Spring Boot, ReactJS, NoSQL.
• Maintain governance across delivery and production processes.
• Act as delivery lead with senior leadership for escalations and ramp-downs.
• Provide technical direction across delivery and architecture.
• Write user stories and acceptance criteria in agile/scrum.
• Coordinate work across disciplines to maintain progress.
• Ensure alignment with customer processes and methodologies.
• Establish continuous delivery risk management framework.
• Monitor and improve delivery productivity.
• Serve as technical resource for Data Engineers.
• Oversee production support and deployments.

Conocimientos

Python data engineering

SQL

Apache Spark

PySpark

Java

Scala

Leadership

Agile/Scrum

English (B2+)

Herramientas

Databricks

Kafka

Spark Streaming

Spring Boot

ReactJS

NoSQL

Anthropic Claude Code

Descripción del empleo

We are looking for a Lead Data Software Engineer to join our company. This position brings together hands-on technical work and leadership responsibility, offering the chance to shape data architecture while driving delivery on critical projects. You will work closely with stakeholders and engineering teams to make sure solutions stay reliable and scalable as demands evolve. If you enjoy pairing hands-on technical involvement with accountability for delivery success, this role could be a strong fit for you.ResponsibilitiesDevelop and preserve the codebase supporting ETL and ELT pipelines, together with large batch, micro-batch, and streaming systemsSet up the infrastructure required to pull, transform, and load data efficiently from a variety of sources using ADF, Spark, Kafka, or comparable technologiesIdentify, plan, and roll out internal process improvements, such as automating manual tasks, improving data delivery, and modifying infrastructure to increase scalabilityArchitect and release data services solutions using technologies such as Spring Boot, ReactJS, NoSQL, and other related UI and API toolsMaintain governance across delivery management and production processes, aligned with the chosen delivery modelAct as the key contact for delivery-related matters with senior leadership and stakeholders, covering escalations, upsells, and ramp-downsProvide technical direction throughout the delivery process, keeping the architecture solid and forward-thinking while ensuring implementation meets quality expectationsWrite user stories and their corresponding acceptance criteria as part of an agile/scrum processCoordinate work across multiple disciplines and stakeholders to keep delivery progressingEnsure project delivery aligns with customer processes and methodologies, applying strong knowledge of different delivery models with an agile-focused approachEstablish a continuous delivery risk management framework that enables proactive decision-making throughout the delivery lifecycleMonitor and enhance delivery productivity over timeServe as a technical resource for Data Engineers, helping ensure their work meets quality and timeliness standardsOversee production support and deployment responsibilitiesRequirementsA minimum of 5 years of experience in a similar positionAt least one year of experience leading and managing teamsSolid command of core Python for data engineering purposesProficient in SQL for querying and processing dataHands-on experience with Apache Spark for large-scale data processingFamiliarity with Anthropic Claude CodeExperience using Databricks for data engineering and analytics tasksExcellent English proficiency (B2 level or higher)Nice to haveExperience with Apache Kafka for managing streaming dataWorking knowledge of JavaHands-on experience with PySparkFamiliarity with ScalaExperience with Spark StreamingWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.