AWS Lead Data Engineer

EXL; Maharashtra; On-site; INR 2,500,000 - 3,800,000; Full time

Job summary

EXL in Pune is seeking a Lead Data Engineer with 9–12 years of experience to spearhead data engineering delivery. The role requires deep expertise in Big Data concepts, cloud implementation, and hands-on Snowflake, Python, and AWS capabilities.

You will guide offshore teams, collaborate with clients, ensure quality, and drive adoption of new technologies while maintaining strong stakeholder communications.

Qualifications

• 9+ years of relevant experience in Data Engineering and project delivery.
• Strong expertise in Big Data concepts and cloud implementation projects.
• Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).
• Excellent hands-on experience with Python, PySpark, and AWS cloud microservices.
• Capability to perform coding, debugging, performance tuning, and deploying applications to production environments.
• Strong problem-solving abilities, analytical skills, and aptitude for ownership.
• Agile Methodology with experience in iterative project deliveries.
• Quick learner with the ability to lead team members in adopting new technologies.
• Exceptional communication and stakeholder management skills.

Responsibilities

• Lead and oversee project delivery, ensuring timely completion with high quality.
• Collaborate with clients and offshore leads to gather requirements and define high-level designs.
• Direct development and unit testing activities while maintaining strong alignment with project goals.
• Communicate effectively with stakeholders, providing regular updates on task and project statuses.
• Identify, track, and address project risks or issues promptly.
• Work closely with management to ensure seamless execution of tasks.
• Provide technical guidance to the team, outlining design, implementation, and delivery strategies.

Skills

Data engineering

Project delivery

Agile methodology

Team leadership

Analytical skills

Ownership

Problem solving

Communication skills

Education

Bachelor's Degree in Engineering (BE/B.Tech)

Tools

Snowflake

SQL

AWS

Glue

EMR

S3

Aurora

RDS

AWS architecture

Python

PySpark

Job description

Role: Lead Data Engineer Experience: 9–12 years

Location : Pune

Must-Have Skills

• 9+ years of relevant experience in Data Engineering and project delivery.
• Strong expertise in Big Data concepts and cloud implementation projects.
• Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).
• Excellent hands-on experience with Python, PySpark, and AWS cloud microservices.
• Capability to perform coding, debugging, performance tuning, and deploying applications to production environments.
• Strong problem-solving abilities, analytical skills, and aptitude for ownership.
• Skilled in Agile Methodology with experience in iterative project deliveries.
• Quick learner with the ability to lead team members in adopting new technologies.
• Exceptional communication and stakeholder management skills.

Good-to-Have Skills

• Familiarity with DevOps tools and practices (e.g., Jenkins, Git) and experience in CI/CD pipelines.
• Knowledge of Spark, SQL (with Snowflake exposure), and advanced Big Data Concepts.
• Experience with cloud migrations and development projects
• Knowledge of US insurance and reinsurance domain
• Knowledge of Data Vault 2.0

Role & Responsibilities

• Lead and oversee project delivery, ensuring timely completion with high quality.
• Collaborate with clients and offshore leads to gather requirements and define high-level designs.
• Direct development and unit testing activities while maintaining strong alignment with project goals.
• Communicate effectively with stakeholders, providing regular updates on task and project statuses.
• Identify, track, and address project risks or issues promptly.
• Work closely with management to ensure seamless execution of tasks.
• Provide technical guidance to the team, outlining design, implementation, and delivery strategies.

Education

• Bachelor’s Degree in Engineering (BE/B.Tech) from a reputed institution.