Lead Data Engineer: Spark & Cloud Data Pipelines

EPAM Systems; Turkey; In loco; TRY 5.941.000 - 7.921.000; Tempo pieno

Vantaggi offerti da questo lavoro

Continuous upskilling

Internal courses

Mentoring programs

Certification support

Private health insurance

Referral bonuses

USD compensation

On-site facilities

Descrizione del lavoro

EPAM Systems seeks a hands-on Lead Data Software Engineer with deep expertise in Apache Spark and large-scale distributed computing. You will own end-to-end data infrastructure—from ingestion to reliable, scalable pipelines—while collaborating across teams to translate business requirements into robust technical solutions.

The ideal candidate brings 5+ years in data software engineering, strong Python/SQL skills, and leadership experience.

Competenze

• 5+ years of experience in Data Software Engineering focused on large-scale distributed systems.
• Track record designing modular components and scalable tech stacks for performance.
• Experience as a Team Lead providing technical guidance and customer interaction.
• Proficient in Python and SQL.
• Hands-on with Apache Spark, Kafka, and Airflow.
• Cloud proficiency with AWS, Azure, or GCP.
• Databricks or Snowflake experience is a plus.
• Spark performance tuning and SDLC/Agile awareness.
• Strong English communication skills.

Mansioni

• Lead design and implementation of data ingestion solutions and pipelines using Cloud Native and Big Data technologies.
• Provide daily guidance and mentorship; act as the technical point of contact for customers.
• Manage full tech stack: configuration, monitoring, debugging, and tuning.
• Develop and maintain scalable data pipelines for processing and analysis.
• Collaborate with data architects to translate requirements into specs.
• Lead code reviews and ensure SDLC best practices and quality gates.
• Create and maintain detailed technical documentation for data projects.
• Troubleshoot data issues to ensure reliable, scalable solutions.

Conoscenze

Python

SQL

Team Leadership

Apache Spark

Cloud Platforms

Distributed Systems

SDLC & Agile

English Proficiency

Performance Tuning

Cross-functional Collaboration

Strumenti

Kafka

Airflow

Databricks

Snowflake

Descrizione del lavoro

EPAM Systems seeks a hands-on Lead Data Software Engineer with deep expertise in Apache Spark and large-scale distributed computing. You will own end-to-end data infrastructure—from ingestion to reliable, scalable pipelines—while collaborating across teams to translate business requirements into robust technical solutions.

The ideal candidate brings 5+ years in data software engineering, strong Python/SQL skills, and leadership experience.