Senior Data Engineer

Persistent; Pune District; On-site; INR 1,000,000 - 1,600,000; Full time

Benefits offered by this job

Competitive salary and benefits

Education and certifications support

Working with cutting-edge technologies

Long Service awards

Annual health check-ups

Insurance coverage

Job summary

Persistent is seeking a Senior Data Engineer to design and maintain Azure-based data pipelines across our health care solutions. You will collaborate with data analysts, scientists, and business stakeholders to translate data needs into scalable architectures.

The role emphasizes cost-effective, secure data handling with CI/CD practices and documentation of data workflows. Location is Pune with flexible/Hybrid options and a strong focus on growth and learning opportunities.

Qualifications

• Design, develop, and maintain end-to-end data pipelines on Azure.
• Build ETL/ELT workflows using Azure Data Factory.
• Develop scalable data processing using Azure Databricks and PySpark.
• Manage and optimize data storage with ADLS Gen2.
• Write efficient SQL for data transformation, validation and analysis.

Responsibilities

• Ensure data quality, governance, and security best practices.
• Collaborate with data analysts, data scientists, and stakeholders to understand data requirements.
• Monitor, troubleshoot, and optimize data pipelines for performance and cost.
• Implement CI/CD practices for data engineering solutions.
• Document data architectures, workflows, and best practices.

Skills

Data pipeline design

CI/CD for data engineering

Data governance

Performance optimization

Tools

Azure Data Factory

Azure Databricks

PySpark

Azure Data Lake (ADLS Gen2)

SQL

Job description

Job Description

About Position:

As a Data Engineer, you will have the opportunity to be a member of a focused team dedicated to helping to make the health care system work better for everyone. Here, you'll partner with some of the smartest people you've ever worked with to design solutions to meet a wide range of health consumer needs.

• Role: Senior Data Engineer
• Location: All Persistent Locations
• Experience: 6 to 12 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, develop, and maintain end-to-end data pipelines using Azure services.
• Build and optimize ETL/ELT workflows using Azure Data Factory.
• Develop scalable data processing solutions using Azure Databricks and PySpark.
• Manage and optimize data storage solutions using Azure Data Lake (ADLS Gen2).
• Write efficient, optimized SQL queries for data transformation, validation, and analysis

Expertise You'll Bring:

• Ensure data quality, data governance, and security best practices.
• Work closely with data analysts, data scientists, and business stakeholders to understand data requirements.
• Monitor, troubleshoot, and optimize data pipelines for performance and cost.
• Implement CI/CD practices for data engineering solutions.
• Document data architectures, workflows, and best practices.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.

Job Classification

Industry: IT Services & ConsultingFunctional Area / Department: IT & Information SecurityRole Category: IT Infrastructure ServicesRole: IT Infrastructure Services - OtherEmployement Type: Full time

Contact Details:

Company: PersistentLocation(s): Pune Ability to work in a team environment with members of varying skill levels. Highly motivated. Learns quickly.