Senior Data Software Engineer - Lead Data Pipelines

EPAM Systems; Colombia; On-site; COP 90,000,000 - 150,000,000; Full time

Benefits offered by this job

Healthcare benefits

Employee financial programs

Paid time off and sick leave

Upskilling, reskilling and certificates

Job summary

EPAM Systems in Colombia seeks a Senior Data Software Engineer to shape data architecture and guide delivery across complex projects. You will collaborate with stakeholders and multi-national teams to deliver robust, scalable data solutions.

You will combine hands-on engineering with technical leadership, overseeing ETL/ELT pipelines, streaming systems, and data services while adhering to agile practices and delivery models.

Qualifications

• 3+ years of relevant experience in data engineering or data software engineering.
• Strong Python skills for data engineering tasks.
• Proficiency in SQL for data manipulation and querying.
• Experience with Apache Spark for large-scale data processing.
• English proficiency at B2 level or higher.

Responsibilities

• Architect and maintain ETL/ELT pipelines and streaming systems.
• Build data ingestion pipelines using Spark, Kafka, and related tech.
• Improve data delivery and redesign infrastructure for scalability.
• Design data services using Spring Boot, ReactJS, NoSQL, and API tools.
• Lead delivery governance and ensure quality across projects.
• Serve as delivery owner, coordinating with management and stakeholders.
• Provide technical leadership and ensure sound architecture for delivery.
• Write user stories and acceptance criteria in an agile workflow.
• Coordinate across disciplines to align delivery efforts.
• Ensure projects follow customer processes and agile methodologies.
• Establish a continuous delivery risk management strategy.
• Measure and improve delivery productivity over time.
• Mentor Data Engineers and support timely delivery.
• Perform production support and deployment activities.

Skills

Python

SQL

English proficiency

Tools

Apache Spark

Databricks

Kafka

Anthropic Claude Code

NoSQL

Job description

EPAM Systems in Colombia seeks a Senior Data Software Engineer to shape data architecture and guide delivery across complex projects. You will collaborate with stakeholders and multi-national teams to deliver robust, scalable data solutions.

You will combine hands-on engineering with technical leadership, overseeing ETL/ELT pipelines, streaming systems, and data services while adhering to agile practices and delivery models.