Lead Data Engineer: Architect & Deliver Scalable Pipelines

EPAM Systems; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Healthcare benefits

Employee training & certificates

Paid time off

Job summary

EPAM Systems, Inc. seeks a Lead Data Software Engineer to blend hands-on data engineering with technical leadership. You will design and maintain ETL/ELT pipelines, build scalable data services, and drive delivery with stakeholders and teams.

The role emphasizes architecture, governance, agile processes, and mentoring data engineers, with exposure to Spark, Databricks, Kafka, Java, Python, and modern UI/API tools.

Qualifications

• 5+ years in data engineering leadership and delivery.
• Strong Python for data engineering tasks.
• SQL proficiency for data querying and processing.
• Hands-on experience with Apache Spark for large-scale processing.
• Experience with Databricks and Kafka workflows.
• Familiarity with Anthropic Claude Code.
• Proficient in English (B2 or higher).

Responsibilities

• Develop and maintain ETL/ELT pipelines and streaming systems.
• Architect and release data services with Spring Boot, ReactJS, NoSQL.
• Set up data infrastructure for efficient data movement from multiple sources.
• Provide technical direction and governance across delivery processes.
• Write user stories and acceptance criteria in an Agile/Scrum context.
• Coordinate work across disciplines and stakeholders to maintain delivery momentum.

Skills

Leadership

Agile

English proficiency

Tools

Databricks

Apache Spark

PySpark

Kafka

Java

Spring Boot

ReactJS

NoSQL

Scala

Spark Streaming

Anthropic Claude Code

Job description

EPAM Systems, Inc. seeks a Lead Data Software Engineer to blend hands-on data engineering with technical leadership. You will design and maintain ETL/ELT pipelines, build scalable data services, and drive delivery with stakeholders and teams.

The role emphasizes architecture, governance, agile processes, and mentoring data engineers, with exposure to Spark, Databricks, Kafka, Java, Python, and modern UI/API tools.