Lead Data Engineer

Persistent Systems; Pune District; On-site; INR 2,500,000 - 4,500,000; Full time

Benefits offered by this job

Hybrid work options

Flexible work hours

Insurance coverage

Job summary

Persistent Systems in Pune seeks a Lead Data Engineer to drive end-to-end data solutions on Snowflake and Azure. You will design, implement, and optimize scalable data pipelines and collaborate with cross-functional teams to deliver robust analytics platforms.

The role emphasizes governance, data quality, performance tuning, and mentoring engineers, with exposure to modern data platforms and CI/CD practices in a hybrid work environment.

Qualifications

• 8-12 years of Data Engineering experience with team leadership.
• Expertise in Snowflake data warehousing, performance tuning, SnowSQL, tasks, streams.
• Strong Python skills for data processing and pipeline development.
• Proficiency with Azure Data Factory, ADLS Gen2, and Synapse Analytics.

Responsibilities

• Design and implement end-to-end data engineering solutions using Snowflake, Python, and Azure.
• Build, optimize, and maintain scalable ETL/ELT pipelines using Snowflake, Python, ADF, ADLS Gen2, and Synapse.
• Develop data ingestion, transformation, and orchestration frameworks for analytics needs.
• Provide technical leadership, conduct code reviews, and drive best practices across the team.
• Ensure high performance, scalability, security, and cost optimization of Snowflake-based platforms.
• Collaborate with stakeholders, architects, and engineering teams to deliver robust data solutions.
• Drive data modeling, governance, data quality, and metadata management initiatives.
• Troubleshoot production issues and support delivery planning.

Skills

Snowflake

Python

SQL

Data modeling

Kafka

Databricks

Lakehouse

CI/CD

DevOps

Agile

Tools

Azure

ADF

ADLS Gen2

Synapse Analytics

Job description

Lead Data Engineer role driving end-to-end Azure and Snowflake data solutions, ensuring scalable pipelines, strong governance, and technical leadership across data engineering teams.

• Lead Data Engineer
• Pune
• 8 to 12 years
• Full-Time Employment

What You'll Do:

• Design and implement end-to-end data engineering solutions using Snowflake, Python, and Azure.
• Build, optimize, and maintain scalable ETL/ELT pipelines using Snowflake, Python, ADF, ADLS Gen2, and Synapse.
• Develop data ingestion, transformation, and orchestration frameworks to support analytics and business intelligence needs.
• Provide technical leadership, conduct code reviews, and drive engineering best practices across the team.
• Ensure high performance, scalability, security, and cost optimization of Snowflake-based data platforms.
• Collaborate with business stakeholders, architects, and engineering teams to deliver robust data solutions.
• Drive data modeling, governance, data quality, and metadata management initiatives.
• Troubleshoot production issues and support delivery planning and execution.

Expertise You'll Bring:

• 8 to 12 years of experience in Data Engineering, including team handling/technical leadership experience.
• Strong hands‑on experience with Snowflake (Data Warehousing, Performance Tuning, SnowSQL, Tasks, Streams, Stored Procedures).
• Advanced proficiency in Python for data processing, automation, and pipeline development.
• Strong experience with Azure Data Factory (ADF), ADLS Gen2, and Synapse Analytics.
• Expertise in designing and developing complex ETL/ELT pipelines.
• Strong knowledge of SQL, Database Design, and Data Modeling.
• Experience with data transformation frameworks and large‑scale data processing.
• Experience with Kafka, Event Hub, or other streaming technologies.
• Knowledge of Databricks/Lakehouse architecture.
• Exposure to CI/CD, DevOps, and Data Governance frameworks.
• Experience working with Agile delivery methodologies.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting‑edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.