AWS Lead Data Engineer

EXL Talent Acquisition Team; Gurugram District; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

EXL Talent Acquisition Team in Gurugram seeks a Lead Data Engineer with 9+ years of data engineering experience to drive delivery on cloud-based big data projects. You will lead technical design, hands-on development (Python, PySpark), and oversee AWS cloud services integration while coordinating with offshore teams and stakeholders.

You will mentor the team, champion best practices in Agile delivery, and ensure high-quality results within timelines.

Qualifications

• 9+ years of experience in Data Engineering and project delivery.
• Strong expertise in Big Data concepts and cloud implementation projects.
• Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).
• Excellent hands-on experience with Python, PySpark, and AWS cloud microservices.

Responsibilities

• Lead and oversee project delivery, ensuring timely completion with high quality.
• Collaborate with clients and offshore leads to gather requirements and define high-level designs.
• Direct development and unit testing activities while maintaining alignment with project goals.
• Communicate effectively with stakeholders, providing regular updates on task and project statuses.
• Identify, track, and address project risks or issues promptly.
• Work closely with management to ensure seamless execution of tasks.
• Provide technical guidance to the team, outlining design, implementation, and delivery strategies.

Skills

Snowflake

SQL

AWS

Python

PySpark

AWS cloud services

Agile

Leadership

Stakeholder management

Education

BE/B.Tech in Engineering

Tools

Jenkins

Git

Spark

CI/CD pipelines

Job description

Role: Lead Data Engineer Experience: 9-12 years

Location: Gurugram

Must-Have Skills:

• 9+ years of relevant experience in Data Engineering and project delivery.
• Strong expertise in Big Data concepts and cloud implementation projects.
• Proficient in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, AWS architecture).
• Excellent hands-on experience with Python, PySpark, and AWS cloud microservices.
• Capability to perform coding, debugging, performance tuning, and deploying applications to production environments.
• Strong problem-solving abilities, analytical skills, and aptitude for ownership.
• Skilled in Agile Methodology with experience in iterative project deliveries.
• Quick learner with the ability to lead team members in adopting new technologies.
• Exceptional communication and stakeholder management skills.

Good-to-Have Skills:

• Familiarity with DevOps tools and practices (e.g., Jenkins, Git) and experience in CI/CD pipelines.
• Knowledge of Spark, SQL (with Snowflake exposure), and advanced Big Data Concepts.
• Experience with cloud migrations and development projects
• Knowledge of US insurance and reinsurance domain
• Knowledge of Data Vault 2.0

Role & Responsibilities:

• Lead and oversee project delivery, ensuring timely completion with high quality.
• Collaborate with clients and offshore leads to gather requirements and define high-level designs.
• Direct development and unit testing activities while maintaining strong alignment with project goals.
• Communicate effectively with stakeholders, providing regular updates on task and project statuses.
• Identify, track, and address project risks or issues promptly.
• Work closely with management to ensure seamless execution of tasks.
• Provide technical guidance to the team, outlining design, implementation, and delivery strategies.

Education:

• Bachelor's Degree in Engineering (BE/B.Tech) from a reputed institution.