Manager-Data Engineering-Big Data Engineering

EXL

Maharashtra

On-site

INR 4,000,000 - 7,000,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

EXL is seeking a highly skilled Lead Data Engineer to drive end-to-end data engineering initiatives, lead cross-functional teams, and deliver scalable, cloud-based data solutions in a fast-paced environment.

The role requires deep technical expertise with Snowflake, AWS, Python and PySpark, and proven leadership across onshore/offshore teams. You will collaborate with global stakeholders to define architectures and oversee delivery while ensuring governance and best practices are followed.

Qualifications

  • 12+ years of experience in Data Engineering
  • Strong expertise in Big Data concepts and distributed systems
  • Proficiency in Snowflake, SQL, and AWS services (Glue, EMR, S3, Aurora, RDS, Lambda, Step Functions)
  • Hands-on experience with Python and PySpark
  • Leadership and stakeholder management experience
  • Experience in Agile/Scrum environments with iterative delivery cycles
  • Excellent communication and collaboration skills

Responsibilities

  • Lead and mentor onshore and offshore data engineering teams
  • Define high-level solution designs and data architectures for cloud-based platforms
  • Drive development, code reviews, testing, and production deployments
  • Ensure performance, scalability, and reliability of data pipelines
  • Collaborate with clients, product owners, and business leaders
  • Identify risks and implement mitigation plans
  • Coordinate multi-region delivery efforts

Skills

Data engineering
Big Data
Cloud architectures
Snowflake
SQL
Python
PySpark
AWS
Leadership
Agile Scrum

Tools

Git
Jenkins
GitHub/GitLab

Job description

About The Role

We are seeking a highly skilled Lead Data Engineer to drive end-to-end data engineering initiatives, lead cross-functional teams, and deliver scalable, cloud-based data solutions. The ideal candidate will bring deep technical expertise, strong leadership, and the ability to collaborate effectively with global stakeholders in a fast-paced environment.

Key Responsibilities
Leadership & Team Management
  • Lead and mentor a team of onshore and offshore data engineers to ensure high-quality deliverables.
  • Provide technical direction, coaching, and knowledge sharing to foster team growth and capability building.
  • Establish and enforce engineering best practices, coding standards, and reusable frameworks.
  • Champion innovation, continuous learning, and thought leadership within the data engineering function.
Project Delivery & Execution
  • Oversee end-to-end project delivery, ensuring timely, high-quality execution aligned with project objectives.
  • Define high-level solution designs, data architectures, and ETL/ELT frameworks for cloud-based data platforms.
  • Drive development, code reviews, unit testing, and deployment to production environments.
  • Ensure optimal performance, scalability, and reliability across data pipelines and systems.
Stakeholder Communication & Collaboration
  • Collaborate with clients, product owners, business leaders, and offshore teams to gather requirements and define technical solutions.
  • Communicate project updates, timelines, risks, and technical concepts effectively to both technical and non-technical stakeholders.
  • Act as the primary point of contact for client technical discussions, solution design workshops, and progress reviews.
Risk & Issue Management
  • Proactively identify project risks, dependencies, and issues; develop and execute mitigation plans.
  • Ensure governance, compliance, and alignment with organizational standards and methodologies.
Must-Have Skills
  • 12+ years of experience in Data Engineering with proven experience in delivering enterprise-scale projects.
  • Strong expertise in Big Data concepts, distributed systems, and cloud-native architectures.
  • Proficiency in Snowflake, SQL, and a wide range of AWS services (Glue, EMR, S3, Aurora, RDS, Lambda, Step Functions).
  • Hands-on experience with Python, PySpark, and building cloud-based microservices.
  • Strong problem-solving, analytical skills, and end-to-end ownership mindset.
  • Proven ability to work in Agile/Scrum environments with iterative delivery cycles.
  • Exceptional communication, leadership, and stakeholder management skills.
  • Demonstrated capability in leading onshore–offshore teams and coordinating multi-region delivery efforts.
Good-to-Have Skills
  • Experience with DevOps tools (Jenkins, Git, GitHub/GitLab) and CI/CD pipeline implementation.
  • Experience with cloud migration and large-scale modernization projects.
  • Familiarity with the US insurance/reinsurance domain + P&C Insurance knowledge
  • Knowledge of Data Vault 2.0 and modern data modeling techniques.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Manager-Data Engineering-Big Data Engineering
Manager-Data Engineering-Big Data Engineering

ExlService Holdings, Inc. • Pune District

On-site
INR 3,500,000 - 7,000,000
Lead Data Engineer
Lead Data Engineer

CSM Technologies • Khordha

On-site
INR 1,200,000 - 1,800,000
Lead Data Engineer- AWS
Lead Data Engineer- AWS

EXL • Gurugram District

On-site
INR 4,000,000 - 7,000,000
AWS Lead Data Engineer
AWS Lead Data Engineer

EXL • Gurugram District

On-site
INR 4,200,000 - 6,500,000
Data Engineer
Data Engineer

Bahwan Cybertek Group • Hyderabad

On-site
INR 1,500,000 - 2,100,000
Manager - Data Engineer
Manager - Data Engineer

BDO India • Mumbai

Hybrid
INR 3,600,000 - 5,400,000
Senior Data Engineering Manager [T500-21341]
Senior Data Engineering Manager [T500-21341]

FM • Bengaluru

On-site
INR 2,500,000 - 3,500,000
Lead Data Engineer (Lead Software Engineer)
Lead Data Engineer (Lead Software Engineer)

DigitalXNode • Ahmedabad District

On-site
INR 1,800,000 - 2,600,000
AWS Lead Data Engineer
AWS Lead Data Engineer

ExlService Holdings, Inc. • Gurugram District

On-site
INR 4,000,000 - 7,000,000
Sr Manager Data Engineer
Sr Manager Data Engineer

Amgen Technology • Hyderabad

On-site
INR 3,500,000 - 6,500,000