Lead Data Software Engineer

EPAM Systems; Maharashtra; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

EPAM Systems is seeking a Lead Data Software Engineer to drive end-to-end data solutions in a fast-paced environment. You will partner with cross-functional teams to translate complex requirements into scalable software, leveraging Spark, Python, and cloud services.

Ideal candidates bring 8-12 years of data experience, deep Spark expertise, and strong knowledge of Hadoop and Hive. Opportunities exist to shape cloud data architectures using AWS and Azure within a collaborative team.

Qualifications

• 8-12 years of hands-on experience in data and data-related technologies.
• Expert-level knowledge and practical experience with Apache Spark.
• Strong proficiency with Hadoop and Hive.
• Proficiency in Python and cloud data services (AWS and Azure).

Responsibilities

• Develop and execute end-to-end data solutions for intricate business needs.
• Collaborate with cross-functional teams to understand project requirements and deliver data software solutions.
• Apply Spark, Python, Azure and AWS to build scalable data processing systems.
• Maintain performance, security, and scalability of data applications.
• Stay updated with industry trends to improve development processes.

Skills

Python

Apache Spark

AWS

Azure

Hadoop

Hive

Tools

Hadoop

Hive

Job description

We are seeking an experienced Lead Data Software Engineer to join our dynamic team and tackle rewarding challenges.

Responsibilities

• Develop and execute end-to-end Data solutions for intricate business needs
• Work alongside cross-functional teams to comprehend project requirements and deliver superior software solutions
• Apply your knowledge in Apache Spark, Python, Azure and AWS to build scalable and effective data processing systems
• Maintain the performance, security, and scalability of Data applications
• Keep abreast of industry trends and advancements in Data technologies to enhance our development processes

Requirements

• 8-12 years of hands-on experience in Data and Data-related technologies
• Expert-level knowledge and practical experience with Apache Spark
• Strong proficiency with Hadoop and Hive
• Proficiency in Python
• Experience working with native Cloud data services, specifically AWS and Azure

Nice to have

• Background in machine learning algorithms and techniques
• Skills in data visualization tools such as Tableau or Power BI
• Knowledge of real-time data processing frameworks like Apache Flink or Apache Storm
• Understanding of containerization technologies like Docker or Kubernetes

Technologies

• Hadoop
• Hive