Lead Data Software Engineer

EPAM Systems; Coimbatore District; On-site; INR 3,500,000 - 5,500,000; Full time

Job summary

EPAM Systems in India invites an experienced Lead Data Software Engineer to design and deliver data solutions across diverse projects. You will guide technical direction and mentor teams in Spark, Python, and cloud services.

You will collaborate with cross-functional teams to translate complex business problems into scalable data architectures, ensuring performance, security, and reliability of data platforms. Strong expertise in AWS/Azure with Hadoop/Hive is required.

Qualifications

• 8-12 years of strong experience in Data and related technologies.
• Expertise in Apache Spark.
• Proficiency in Hadoop and Hive.
• Skills in Python.
• Competency in using native Cloud data services such as AWS and Azure.

Responsibilities

• Develop end-to-end Data solutions tailored to complex business demands
• Collaborate with cross-functional teams to understand project needs and ensure exceptional software solutions
• Utilize knowledge of Apache Spark, Python, Azure and AWS to design scalable and efficient systems
• Ensure the performance, security and scalability of Data applications
• Stay updated on emerging trends and innovations in Data technologies to improve development practices

Skills

Spark

Python

AWS

Azure

Tools

Hadoop

Hive

Job description

We are looking for an experienced Lead Data Software Engineer to join our dynamic team and address rewarding challenges.

As a Lead Engineer, you will play a key role in designing and delivering Data solutions across diverse projects. The ideal candidate should have significant expertise in Data and associated technologies, particularly Apache Spark, Python, Azure and AWS.

Responsibilities

• Develop end-to-end Data solutions tailored to complex business demands
• Collaborate with cross-functional teams to understand project needs and ensure exceptional software solutions
• Utilize knowledge of Apache Spark, Python, Azure and AWS to design scalable and efficient systems
• Ensure the performance, security and scalability of Data applications
• Stay updated on emerging trends and innovations in Data technologies to improve development practices

Requirements

• 8-12 years of strong experience in Data and related technologies
• Expertise in Apache Spark
• Proficiency in Hadoop and Hive
• Skills in Python
• Competency in using native Cloud data services such as AWS and Azure

Nice to have

• Background in machine learning algorithms and methods
• Proficiency in data visualization tools like Tableau or Power BI
• Familiarity with real-time data processing frameworks like Apache Flink or Apache Storm
• Capability to work with containerization technologies such as Docker or Kubernetes

Technologies

• Hadoop
• Hive