Lead Data Software Engineer

EPAM Systems; Bengaluru; Presencial; INR 4.200.000 - 6.800.000; Jornada completa

Descripción de la vacante

EPAM Systems is seeking a Lead Data Software Engineer to drive data solution design and implementation across projects. The role emphasizes Apache Spark, Python, and cloud platforms (AWS and Azure) to deliver scalable data processing systems.

The ideal candidate has extensive hands-on data technology experience, including Spark, Hadoop, and Hive, and will lead initiatives across cross-functional teams while ensuring performance, security, and scalability of data applications.

Formación

• 8-12 years of hands-on experience in Data and Data-related technologies.
• Expert-level knowledge of Apache Spark and practical experience.
• Strong proficiency with Hadoop and Hive.
• Proficiency in Python.
• Experience with native Cloud data services, AWS and Azure.

Responsabilidades

• Develop and implement end-to-end Data solutions for complex business needs.
• Collaborate with cross-functional teams to gather requirements and deliver robust software solutions.
• Apply Spark, Python, AWS and Azure to build scalable data processing systems.
• Maintain performance, security and scalability of Data applications.
• Stay updated on industry trends to improve development processes.

Conocimientos

Apache Spark

Python

Hadoop

Hive

AWS

Azure

Descripción del empleo

We are seeking an experienced Lead Data Software Engineer to join our dynamic team and tackle rewarding challenges.

As a Lead Engineer, you will be pivotal in creating and implementing Data solutions across various projects. The ideal candidate will possess deep experience in Data and associated technologies, strongly emphasizing Apache Spark, Python, Azure and AWS.

Responsibilities

• Develop and execute end-to-end Data solutions for intricate business needs
• Work alongside cross-functional teams to comprehend project requirements and deliver superior software solutions
• Apply your knowledge in Apache Spark, Python, Azure and AWS to build scalable and effective data processing systems
• Maintain the performance, security, and scalability of Data applications
• Keep abreast of industry trends and advancements in Data technologies to enhance our development processes

Requirements

• 8-12 years of hands‑on experience in Data and Data‑related technologies
• Expert‑level knowledge and practical experience with Apache Spark
• Strong proficiency with Hadoop and Hive
• Proficiency in Python
• Experience working with native Cloud data services, specifically AWS and Azure

Nice to have

• Background in machine learning algorithms and techniques
• Skills in data visualization tools such as Tableau or Power BI
• Knowledge of real‑time data processing frameworks like Apache Flink or Apache Storm
• Understanding of containerization technologies like Docker or Kubernetes

Technologies

• Hadoop
• Hive