Data Engineer - Senior / Lead

Epam Systems; Chennai District; Hybrid; INR 1,800,000 - 2,400,000; Full time

Job summary

Epam Systems is seeking a Senior/Lead Data Software Engineer to design and deploy advanced data solutions across diverse initiatives. You will work on scalable data platforms and drive technical excellence.

You'll leverage Apache Spark, Python, AWS and Azure to deliver robust data systems, collaborating with cross-functional teams while enhancing performance, security, and reliability.

Qualifications

• 5–8 years of professional data engineering experience.
• Advanced Apache Spark expertise.
• Hands-on Hadoop and Hive experience.
• Strong Python programming skills.
• Deep experience with AWS and Azure data services.

Responsibilities

• Craft complete data solutions capable of addressing sophisticated business challenges
• Coordinate effectively across varied teams to break down project needs and deliver top-tier software outcomes
• Apply hands-on expertise in Apache Spark, Python, Azure, and AWS to engineer data systems that are both scalable and efficient
• Strengthen the performance, security posture, and scalability of data-driven applications
• Track shifts in the industry and rising technologies to fuel innovation and evolve development methods

Tools

Python

Apache Spark

Hadoop

Hive

AWS

Azure

Job description

We're on the lookout for a talented Senior/ Lead Data Software Engineer to join our forward-thinking team, contributing to sophisticated projects that will help you grow both technically and professionally.

In this Senior Engineer capacity, you'll play an essential part in constructing and rolling out data solutions across a variety of initiatives. We're seeking someone with significant depth in Big Data tools, with particular emphasis on Apache Spark, Python, Azure, and AWS.

Responsibilities

• Craft complete data solutions capable of addressing sophisticated business challenges
• Coordinate effectively across varied teams to break down project needs and deliver top-tier software outcomes
• Apply hands-on expertise in Apache Spark, Python, Azure, and AWS to engineer data systems that are both scalable and efficient
• Strengthen the performance, security posture, and scalability of data-driven applications
• Track shifts in the industry and rising technologies to fuel innovation and evolve development methods

Requirements

• Between 5 and 8 years of professional background working with data technologies
• Advanced-level familiarity with Apache Spark
• Practical experience working with Hadoop and Hive
• Strong capability in Python programming
• Deep familiarity with AWS and Azure cloud-based data services

Technologies

• Hadoop
• Hive