Senior Data Engineer

Persistent Systems; Pune District; Hybrid; INR 2,000,000 - 3,500,000; Full time

Benefits offered by this job

Group term life insurance

Mediclaim hospitalisation

Long Service awards

Hybrid work

Job summary

Persistent Systems is seeking a Senior Data Engineer to design and operate secure, scalable data platforms enabling enterprise reporting, analytics, and AI readiness. You will build robust data pipelines, optimize Snowflake warehouses, and enforce data governance across governance, quality, and security domains.

The role requires 6-10 years in data engineering, strong Python/Scala and SQL skills, and hands-on experience with Snowflake, Azure, Spark, and data masking.

Qualifications

• 6-10 years of experience in Data Engineering, Data Platform Development, and Data Governance.
• Strong programming in Python and/or Scala with SQL proficiency.
• Hands-on Snowflake administration, Azure cloud, and data security basics.

Responsibilities

• Design, build, and maintain scalable data pipelines and platforms for analytics and AI.
• Develop and optimize ETL/ELT pipelines for reliable data delivery.
• Design Snowflake-based data warehouses for enterprise reporting and analytics.
• Implement data security controls including masking and encryption.
• Establish data governance: quality, metadata, lineage, and stewardship.

Skills

Python

Scala

Advanced SQL

Data governance

Data modeling

Analytical thinking

Tools

Snowflake

Azure

Apache Spark

Databricks

Kafka

Airflow

Git

Linux

CI/CD

DevOps practices

Job description

We are looking for a highly skilled Senior Data Engineer with expertise in Data Engineering, Data Governance, Data Masking, Snowflake, Azure, and Healthcare Data Platforms. The ideal candidate will be responsible for designing and building secure, scalable, and governed data platforms that support enterprise reporting, analytics, regulatory compliance, and future AI/ML capabilities. This role requires strong experience in cloud-native data architectures, modern data warehousing, data security, and governance practices. The candidate will play a key role in establishing trusted, AI-ready data foundations while ensuring data quality, security, and consistency across the organization.

• Location: All Persistent Locations
• Experience: 6 to 10 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, build, and maintain scalable data pipelines and data platforms to support enterprise analytics and AI initiatives.
• Develop and optimize ETL/ELT pipelines to ensure accurate, reliable, and timely data delivery.
• Design and manage Snowflake-based data warehouse solutions for enterprise reporting and advanced analytics.
• Optimize Snowflake performance through query tuning, clustering, partitioning strategies, and warehouse sizing.
• Implement and manage data security controls including encryption, data masking, tokenization, and row/column-level security.
• Establish and enforce enterprise data governance practices including data quality, metadata management, lineage, and stewardship.
• Collaborate with enterprise architects, BI teams, data engineers, and security teams to deliver trusted and governed data solutions.
• Build a unified semantic layer to standardize KPI definitions and ensure a single source of truth across analytical platforms.
• Monitor system performance, storage utilization, and cloud costs across Snowflake and Azure environments.
• Support healthcare data initiatives while ensuring compliance with privacy, security, and regulatory requirements.
• Participate in architecture reviews and contribute to enterprise data platform standards and best practices.
• Enable future AI and Machine Learning capabilities by creating high-quality, governed, and AI-ready datasets.
• Drive continuous improvements in platform scalability, reliability, and operational efficiency.

Expertise You'll Bring:

• 6-10 years of experience in Data Engineering, Data Platform Development, and Data Governance.
• Strong programming expertise in Python and/or Scala.
• Advanced SQL skills with experience in data modeling, query tuning, and performance optimization.
• Hands-on experience with Snowflake, including architecture, administration, optimization, and security.
• Strong experience designing and implementing large-scale ETL/ELT pipelines.
• Expertise in Azure Cloud Services and cloud-based data architectures.
• Experience working with Apache Spark, Databricks, Kafka, and distributed data processing systems.
• Strong understanding of data warehousing concepts, dimensional modeling, and modern data architectures.
• Experience implementing Data Governance, Data Quality, Data Lineage, Metadata Management, and Data Stewardship frameworks.
• Hands-on experience with Data Masking, Data Classification, PII Protection, Privacy Controls, and Compliance Requirements.
• Knowledge of healthcare data management and healthcare regulatory standards.
• Experience building AI-ready data platforms that support advanced analytics, Machine Learning, and Generative AI initiatives.
• Familiarity with Apache Airflow, CI/CD pipelines, Git, Linux, and DevOps practices.
• Strong analytical, troubleshooting, and stakeholder management skills.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalisation for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

Let's unleash your full potential at Persistent - persistent.com/careers

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."