Lead Data Engineer

Persistent Systems Limited; Pune District; Hybrid; INR 3,000,000 - 5,000,000; Full time

Benefits offered by this job

Health insurance

Education sponsorship

Flexible hours

Long service awards

Hybrid work

Job summary

Persistent Systems Limited in Pune is seeking a Lead Data Engineer to design, build, and maintain scalable data pipelines and platforms for BI, analytics, and reporting. The role emphasizes hands-on Python, SQL, and AWS expertise, with collaboration across stakeholders and Agile delivery practices.

You will architect cloud-based data solutions, mentor junior engineers, and drive data quality, governance, and performance improvements across enterprise data programs.

Qualifications

• 8–12 years of experience in Data Engineering, Data Integration, and Analytics.
• Strong Python programming for data processing and automation.
• Advanced SQL skills and data modeling expertise.
• Hands-on ETL/ELT design and implementation.
• Experience with AWS services including S3, Lambda, Glue, and RDS.
• Agile methodologies and Jira experience.

Responsibilities

• Design, develop, and maintain scalable ETL and ELT workflows for enterprise data platforms.
• Build and manage robust data pipelines to support analytics, reporting, and operational workloads.
• Architect and implement cloud-based data solutions using AWS services (S3, Lambda, Glue, RDS).
• Develop reusable Python-based data processing solutions for automation.
• Write, optimize, and maintain complex SQL queries for data extraction and analytics.
• Design data integration solutions across multiple source and target systems.
• Collaborate with Analysts and stakeholders to gather and refine requirements.
• Translate requirements into technical designs and Jira user stories.
• Participate in Agile ceremonies (sprint planning, stand-ups, retros) and backlog grooming.
• Ensure data quality, governance, and compliance across platforms.
• Monitor and optimize ETL pipelines and production workloads.
• Support data migration and cloud modernization initiatives.
• Develop technical documentation and runbooks.
• Deliver technical demos and solution walkthroughs to stakeholders.
• Collaborate with cross-functional teams to deliver scalable data solutions.
• Mentor junior engineers and promote engineering best practices.

Skills

Python

SQL

AWS

ETL/ELT

Data Modeling

Data Warehousing

Agile

JIRA

Mentoring

Tools

JIRA

Job description

We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what's next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 20 Fortune 50 companies and 4 of the 5 top banks in both the US and India, and numerous innovators across the healthcare ecosystem.

We are seeking a highly skilled Lead Data Engineer with strong expertise in Data Engineering, ETL development, AWS cloud technologies, and analytics solutions. The ideal candidate will play a key role in designing, building, and maintaining scalable data platforms and pipelines that support business intelligence, reporting, and advanced analytics initiatives. The role requires hands-on experience with Python, SQL, AWS services, data integration, and Agile delivery methodologies. You will collaborate closely with business stakeholders, analysts, architects, and engineering teams to deliver reliable, scalable, and high-quality data solutions that drive business outcomes.

• Role: Lead Data Engineer
• Location: Pune
• Experience: 8 to 12 Years
• Job Type: Full Time Employment

What You’ll Do:

• Design, develop, and maintain scalable ETL and ELT workflows for enterprise data platforms.
• Build and manage robust data pipelines to support analytics, reporting, and operational workloads.
• Architect and implement cloud-based data solutions using AWS services such as S3, Lambda, Glue, and RDS.
• Develop reusable and maintainable Python-based solutions for data processing, transformation, and automation.
• Write, optimize, and maintain complex SQL queries for data extraction, reporting, and analytics.
• Design data integration solutions across multiple source and target systems.
• Collaborate with Business Analysts and stakeholders to gather, analyze, and refine business requirements.
• Translate business requirements into technical designs, implementation plans, and JIRA user stories.
• Participate in Agile ceremonies including sprint planning, stand-ups, retrospectives, and backlog grooming sessions.
• Ensure data quality, integrity, governance, and compliance standards are maintained across platforms.
• Monitor, troubleshoot, and optimize ETL pipelines and production workloads.
• Support data migration, platform modernization, and cloud transformation initiatives.
• Develop technical documentation, design specifications, and operational runbooks.
• Deliver technical presentations, demonstrations, and solution walkthroughs to stakeholders.
• Collaborate with cross-functional teams to deliver scalable and high-performing data solutions.
• Mentor junior engineers and contribute to engineering best practices and continuous improvement initiatives.

Expertise You’ll Bring:

• 8?12 years of experience in Data Engineering, Data Integration, and Analytics solutions.
• Strong programming expertise in Python for data engineering, automation, and data transformation.
• Advanced SQL skills with strong understanding of relational database concepts and data modeling.
• Hands-on experience designing and implementing ETL/ELT pipelines and workflows.
• Strong experience working with AWS cloud services including Amazon S3, AWS Lambda, AWS Glue, Amazon RDS.
• Experience building scalable, reliable, and high-performance data engineering solutions.
• Strong understanding of data modeling, data transformation, and data integration best practices.
• Experience with enterprise data warehousing and analytics platforms.
• Knowledge of data governance, data quality, metadata management, and compliance frameworks.
• Experience supporting data migration and data modernization projects.
• Familiarity with Agile methodologies and tools such as JIRA.
• Experience collaborating with Business Analysts and business stakeholders throughout project lifecycles.
• Ability to translate business requirements into technical solutions and implementation plans.
• Strong troubleshooting, analytical, and problem-solving capabilities.
• Excellent communication, presentation, and stakeholder management skills.
• Experience leading technical workstreams and driving delivery ownership.
• Ability to mentor junior engineers and promote knowledge-sharing within teams.
• Familiarity with cloud-native data architectures and modern data engineering practices.
• Life Sciences, Healthcare, or regulated industry experience is an added advantage.
• Strong attention to detail and commitment to delivering high-quality data solutions.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

?Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.?