AWS Lead Data Engineer

EXL Talent Acquisition Team; Pune District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

EXL Talent Acquisition Team in Pune is seeking a Lead Data Engineer with 9+ years of experience to lead data engineering initiatives and project delivery. The role emphasizes hands-on Snowflake, SQL, and AWS expertise, including PySpark and Python, with a focus on delivering scalable cloud-based solutions.

You will guide a technical team, collaborate with clients and offshore leads, and own implementation, testing, and deployment in production environments while driving best practices and rapid

Qualifications

• 9+ years of relevant experience in Data Engineering and project delivery.
• Strong expertise in Big Data concepts and cloud implementation projects.
• Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).
• Excellent hands-on experience with Python, PySpark, and AWS cloud microservices.
• Capability to perform coding, debugging, performance tuning, and deploying applications to production environments.
• Strong problem-solving abilities, analytical skills, and ownership mindset.
• Skilled in Agile Methodology with experience in iterative project deliveries.
• Quick learner with ability to lead team members in adopting new technologies.
• Exceptional communication and stakeholder management skills.

Responsibilities

• Lead and oversee project delivery, ensuring timely completion with high quality.
• Collaborate with clients and offshore leads to gather requirements and define high-level designs.
• Direct development and unit testing activities while maintaining alignment with project goals.
• Communicate effectively with stakeholders, providing regular updates on task and project statuses.
• Identify, track, and address project risks or issues promptly.
• Work closely with management to ensure seamless execution of tasks.
• Provide technical guidance to the team, outlining design, implementation, and delivery strategies.

Skills

Data engineering

Project delivery

Leadership

Team mentoring

Stakeholder management

Education

Bachelor’s Degree in Engineering

Tools

Snowflake

SQL

AWS

PySpark

Python

AWS services

Job description

Role: Lead Data Engineer Experience: 9–12 years

Location: Pune

Must-Have Skills:

• 9+ years of relevant experience in Data Engineering and project delivery.
• Strong expertise in Big Data concepts and cloud implementation projects.
• Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).
• Excellent hands-on experience with Python, PySpark, and AWS cloud microservices.
• Capability to perform coding, debugging, performance tuning, and deploying applications to production environments.
• Strong problem-solving abilities, analytical skills, and aptitude for ownership.
• Skilled in Agile Methodology with experience in iterative project deliveries.
• Quick learner with the ability to lead team members in adopting new technologies.
• Exceptional communication and stakeholder management skills.

Good-to-Have Skills:

• Familiarity with DevOps tools and practices (e.g., Jenkins, Git) and experience in CI/CD pipelines.
• Knowledge of Spark, SQL (with Snowflake exposure), and advanced Big Data Concepts.
• Experience with cloud migrations and development projects
• Knowledge of US insurance and reinsurance domain
• Knowledge of Data Vault 2.0

Role & Responsibilities:

• Lead and oversee project delivery, ensuring timely completion with high quality.
• Collaborate with clients and offshore leads to gather requirements and define high-level designs.
• Direct development and unit testing activities while maintaining strong alignment with project goals.
• Communicate effectively with stakeholders, providing regular updates on task and project statuses.
• Identify, track, and address project risks or issues promptly.
• Work closely with management to ensure seamless execution of tasks.
• Provide technical guidance to the team, outlining design, implementation, and delivery strategies.

Education:

• Bachelor’s Degree in Engineering (BE/B.Tech) from a reputed institution.