Lead Data Engineer- AWS

EXL Talent Acquisition Team; Gurugram District; On-site; INR 3,800,000 - 7,000,000; Full time

Job summary

EXL Talent Acquisition Team in India is seeking a Lead Data Engineer with 9–12 years of experience to lead data engineering projects across on-site Pune or Gurgaon.

You will drive design, development and delivery, mentor team members, collaborate with clients, and ensure quality with Agile practices.

The role requires strong Snowflake, SQL, AWS, Python and PySpark skills, plus excellent communication and stakeholder management.

Qualifications

• Bachelor’s degree in Engineering (BE/B.Tech) from a reputed institution.
• 9+ years of data engineering and project delivery experience.
• Strong expertise in Big Data concepts and cloud implementation projects.
• Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).
• Excellent hands-on experience with Python, PySpark, and AWS cloud microservices.

Responsibilities

• Lead and oversee project delivery, ensuring timely completion with high quality.
• Collaborate with clients and offshore leads to gather requirements and define high-level designs.
• Direct development and unit testing activities while maintaining strong alignment with project goals.
• Communicate effectively with stakeholders, providing regular updates on task and project statuses.
• Identify, track, and address project risks or issues promptly.
• Work closely with management to ensure seamless execution of tasks.
• Provide technical guidance to the team, outlining design, implementation, and delivery strategies.

Skills

Big Data concepts

Cloud implementation

Snowflake

SQL

AWS services

Python

PySpark

AWS cloud microservices

Agile methodology

Stakeholder management

Education

BE/B.Tech

Tools

Jenkins

Git

Spark

Snowflake

Job description

• Experience (In Years) 9-12

Job Description

Responsibilities

Role: Lead Data Engineer Experience: 9–12 years

Location : Pune/Gurugram

Must-Have Skills:

• 9+ years of relevant experience in Data Engineering and project delivery.
• Strong expertise in Big Data concepts and cloud implementation projects.
• Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).
• Excellent hands-on experience with Python, PySpark, and AWS cloud microservices.
• Capability to perform coding, debugging, performance tuning, and deploying applications to production environments.
• Strong problem-solving abilities, analytical skills, and aptitude for ownership.
• Skilled in Agile Methodology with experience in iterative project deliveries.
• Quick learner with the ability to lead team members in adopting new technologies.
• Exceptional communication and stakeholder management skills.

Good-to-Have Skills:

• Familiarity with DevOps tools and practices (e.g., Jenkins, Git) and experience in CI/CD pipelines.
• Knowledge of Spark, SQL (with Snowflake exposure), and advanced Big Data Concepts.
• Experience with cloud migrations and development projects
• Knowledge of US insurance and reinsurance domain
• Knowledge of Data Vault 2.0

Role & Responsibilities:

• Lead and oversee project delivery, ensuring timely completion with high quality.
• Collaborate with clients and offshore leads to gather requirements and define high-level designs.
• Direct development and unit testing activities while maintaining strong alignment with project goals.
• Communicate effectively with stakeholders, providing regular updates on task and project statuses.
• Identify, track, and address project risks or issues promptly.
• Work closely with management to ensure seamless execution of tasks.
• Provide technical guidance to the team, outlining design, implementation, and delivery strategies.

Education:

• Bachelor’s Degree in Engineering (BE/B.Tech) from a reputed institution.

Qualifications

Bachelor’s Degree in Engineering (BE/B.Tech) from a reputed institution.