Lead Data Software Engineer

EPAM Systems; Hyderabad; On-site; INR 3,500,000 - 5,500,000; Full time

Benefits offered by this job

ML knowledge (nice-to-have)

Tableau/Power BI (nice-to-have)

Flink/Storm (nice-to-have)

Docker/Kubernetes (nice-to-have)

Job summary

EPAM Systems in Hyderabad is seeking an experienced Lead Data Software Engineer to lead end-to-end data initiatives and deliver scalable data processing solutions.

You will collaborate with multi-disciplinary teams and apply Apache Spark, Python, Hadoop, Hive, and cloud services on AWS and Azure to drive performance, security, and scalability of our data applications.

Qualifications

• 8-12 years of hands-on experience in Data and Data-related technologies.
• Expert-level knowledge and practical experience with Apache Spark.
• Strong proficiency with Hadoop and Hive.
• Proficiency in Python and experience with native Cloud data services (AWS/Azure).

Responsibilities

• Develop and execute end-to-end Data solutions for intricate business needs.
• Work with cross-functional teams to understand project requirements and deliver data solutions.
• Apply Spark, Python, Azure and AWS to build scalable data processing systems.
• Maintain performance, security, and scalability of Data applications.
• Stay updated with industry trends to enhance development processes.

Tools

Apache Spark

Hadoop

Hive

Python

AWS

Azure

Job description

We are seeking an experienced Lead Data Software Engineer to join our dynamic team and tackle rewarding challenges.

Responsibilities

• Develop and execute end-to-end Data solutions for intricate business needs
• Work alongside cross-functional teams to comprehend project requirements and deliver superior software solutions
• Apply your knowledge in Apache Spark, Python, Azure and AWS to build scalable and effective data processing systems
• Maintain the performance, security, and scalability of Data applications
• Keep abreast of industry trends and advancements in Data technologies to enhance our development processes

Requirements

• 8-12 years of hands-on experience in Data and Data-related technologies
• Expert-level knowledge and practical experience with Apache Spark
• Strong proficiency with Hadoop and Hive
• Proficiency in Python
• Experience working with native Cloud data services, specifically AWS and Azure

Nice to have

• Background in machine learning algorithms and techniques
• Skills in data visualization tools such as Tableau or Power BI
• Knowledge of real-time data processing frameworks like Apache Flink or Apache Storm
• Understanding of containerization technologies like Docker or Kubernetes

Technologies

• Hadoop
• Hive