Lead Data Software Engineer

EPAM Systems, Inc.; United States; Remoto; USD 140.000 - 190.000; Tempo pieno

Vantaggi offerti da questo lavoro

Healthcare benefits

Employee training & certificates

Paid time off

Descrizione del lavoro

EPAM Systems, Inc. seeks a Lead Data Software Engineer to blend hands-on data engineering with technical leadership. You will design and maintain ETL/ELT pipelines, build scalable data services, and drive delivery with stakeholders and teams.

The role emphasizes architecture, governance, agile processes, and mentoring data engineers, with exposure to Spark, Databricks, Kafka, Java, Python, and modern UI/API tools.

Competenze

• 5+ years in data engineering leadership and delivery.
• Strong Python for data engineering tasks.
• SQL proficiency for data querying and processing.
• Hands-on experience with Apache Spark for large-scale processing.
• Experience with Databricks and Kafka workflows.
• Familiarity with Anthropic Claude Code.
• Proficient in English (B2 or higher).

Mansioni

• Develop and maintain ETL/ELT pipelines and streaming systems.
• Architect and release data services with Spring Boot, ReactJS, NoSQL.
• Set up data infrastructure for efficient data movement from multiple sources.
• Provide technical direction and governance across delivery processes.
• Write user stories and acceptance criteria in an Agile/Scrum context.
• Coordinate work across disciplines and stakeholders to maintain delivery momentum.

Conoscenze

Leadership

Agile

English proficiency

Strumenti

Databricks

Apache Spark

PySpark

Kafka

Java

Spring Boot

ReactJS

NoSQL

Scala

Spark Streaming

Anthropic Claude Code

Descrizione del lavoro

We are looking for a Lead Data Software Engineer to join our company. This position brings together hands-on technical work and leadership responsibility, offering the chance to shape data architecture while driving delivery on critical projects. You will work closely with stakeholders and engineering teams to make sure solutions stay reliable and scalable as demands evolve. If you enjoy pairing hands-on technical involvement with accountability for delivery success, this role could be a strong fit for you.ResponsibilitiesDevelop and preserve the codebase supporting ETL and ELT pipelines, together with large batch, micro-batch, and streaming systemsSet up the infrastructure required to pull, transform, and load data efficiently from a variety of sources using ADF, Spark, Kafka, or comparable technologiesIdentify, plan, and roll out internal process improvements, such as automating manual tasks, improving data delivery, and modifying infrastructure to increase scalabilityArchitect and release data services solutions using technologies such as Spring Boot, ReactJS, NoSQL, and other related UI and API toolsMaintain governance across delivery management and production processes, aligned with the chosen delivery modelAct as the key contact for delivery-related matters with senior leadership and stakeholders, covering escalations, upsells, and ramp-downsProvide technical direction throughout the delivery process, keeping the architecture solid and forward-thinking while ensuring implementation meets quality expectationsWrite user stories and their corresponding acceptance criteria as part of an agile/scrum processCoordinate work across multiple disciplines and stakeholders to keep delivery progressingEnsure project delivery aligns with customer processes and methodologies, applying strong knowledge of different delivery models with an agile-focused approachEstablish a continuous delivery risk management framework that enables proactive decision-making throughout the delivery lifecycleMonitor and enhance delivery productivity over timeServe as a technical resource for Data Engineers, helping ensure their work meets quality and timeliness standardsOversee production support and deployment responsibilitiesRequirementsA minimum of 5 years of experience in a similar positionAt least one year of experience leading and managing teamsSolid command of core Python for data engineering purposesProficient in SQL for querying and processing dataHands-on experience with Apache Spark for large-scale data processingFamiliarity with Anthropic Claude CodeExperience using Databricks for data engineering and analytics tasksExcellent English proficiency (B2 level or higher)Nice to haveExperience with Apache Kafka for managing streaming dataWorking knowledge of JavaHands-on experience with PySparkFamiliarity with ScalaExperience with Spark StreamingWe offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedIn