Lead Data Software Engineer

EPAM Systems; India; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

EPAM Systems is looking for a Lead Data Software Engineer to join its dynamic team in India. The ideal candidate will play a key role in designing and implementing comprehensive Data solutions utilizing advanced technologies like Apache Spark, Python, AWS, and Azure.

Responsibilities include developing tailored Data solutions for complex business challenges and maintaining the efficiency and scalability of applications. With 8-12 years of experience, you will collaborate with cross-functional teams to deliver high-quality software.

Qualifications

• 8–12 years of hands-on experience in Data and Data-related technologies.
• Expert-level knowledge and practical experience with Apache Spark.
• Proficiency in Python.

Responsibilities

• Develop and execute end-to-end Data solutions for intricate business needs.
• Work alongside cross-functional teams to comprehend project requirements and deliver superior software solutions.
• Maintain the performance, security, and scalability of Big Data applications.

Skills

Apache Spark

Python

Hadoop

AWS

Azure

Data visualization tools (Tableau, PowerBI)

Real-time data processing frameworks (Apache Flink, Apache Storm)

Containerization technologies (Docker, Kubernetes)

Tools

Hadoop

Hive

Job description

We are seeking an experienced Lead Data Software Engineer to join our dynamic team and tackle rewarding challenges. As a Lead Engineer, you will be pivotal in creating and implementing Data solutions across various projects. The ideal candidate will possess deep experience in Data and associated technologies, strongly emphasizing Apache Spark, Python, Azure and AWS.

Responsibilities

• Develop and execute end-to-end Data solutions for intricate business needs.
• Work alongside cross‑functional teams to comprehend project requirements and deliver superior software solutions.
• Apply your knowledge in Apache Spark, Python, Azure and AWS to build scalable and effective data processing systems.
• Maintain the performance, security, and scalability of Big Data applications.
• Keep abreast of industry trends and advancements in Big Data technologies to enhance our development processes.

Requirements

• 8–12 years of hands‑on experience in Data and Data‑related technologies.
• Expert‑level knowledge and practical experience with Apache Spark.
• Proficiency in Python.
• Strong proficiency with Hadoop and Hive.
• Experience working with native Cloud data services, specifically AWS and Azure.
• Skills in data visualization tools such as Tableau or PowerBI.
• Knowledge of real‑time data processing frameworks like Apache Flink or Apache Storm.
• Understanding of containerization technologies like Docker or Kubernetes.

Nice to have

• Background in machine learning algorithms and techniques.

Technologies

• Hadoop
• Hive