Senior Azure Data Engineer

Persistent; Pune District; On-site; INR 4,200,000 - 7,200,000; Full time

Benefits offered by this job

Competitive salary

Education & certifications sponsorship

Exposure to cutting-edge tech

Employee engagement activities

Annual health check-ups

Insurance coverage: life, accident, &醫

Job summary

Persistent is seeking a Senior Azure Data Engineer with 6–10 years of hands-on experience in cloud-based data platforms. You will design and maintain scalable data pipelines using Azure/AWS, Databricks, Spark, and Snowflake to support analytics and enterprise applications.

You will collaborate with distributed teams, implement CI/CD and DataOps, ensure security and governance, and optimize both batch and real-time processing for performance and reliability.

Qualifications

• 6–10 years of experience in data engineering and cloud data platform development.
• Hands-on experience with Azure or AWS cloud platforms.
• 5+ years with Databricks and Apache Kafka.
• Experience designing Snowflake-based data solutions.
• Strong ETL/ELT, data ingestion, and orchestration skills.
• Experience with RESTful APIs and microservices.
• CI/CD, DevOps practices, and automation familiarity.
• Experience in Agile/Scrum environments and distributed teams.

Responsibilities

• Collaborate with product owners, analysts, architects, and engineers to deliver scalable data solutions.
• Design, develop, test, and maintain data pipelines using Azure/AWS, Databricks, Spark, and Snowflake.
• Build batch and real-time processing for analytics and reporting.
• Develop ETL/ELT pipelines with modern cloud-native practices.
• Work with structured and unstructured data, DBs, and API integrations.
• Implement scalable, secure, fault-tolerant data platforms and DevOps practices.
• Monitor production issues and participate in incident management and RCA.
• Leverage RESTful APIs and data services for accessible data access.

Skills

Analytical thinking

Troubleshooting

Communication

Stakeholder management

Team collaboration

Tools

Azure Cloud

AWS Cloud

Databricks

Snowflake

Apache Spark

Apache Kafka

RESTful APIs

CI/CD

Job description

About Position:

We are seeking an experienced Senior Azure Data Engineer with 6 to 10 years of hands-on experience in designing, developing, and maintaining modern cloud-based data platforms. The ideal candidate will possess strong expertise in Azure/AWS cloud technologies, Databricks, Snowflake, Spark, Kafka, and large-scale data processing solutions. You will work closely with product owners, architects, and engineering teams to deliver scalable, secure, and high-performance data solutions that support analytics, reporting, and business-critical applications within the healthcare ecosystem.

• Role: Senior Azure Data Engineer
• Location: All Persistent Locations
• Experience: 6 to 10 Years
• Job Type: Full-Time Employment

What You'll Do:

• Collaborate with product owners, business analysts, architects, and software engineers to deliver data solutions aligned with Agile roadmaps.
• Design, develop, test, and maintain scalable data pipelines and data-intensive applications using Azure/AWS, Databricks, Spark, and Snowflake.
• Build and optimize batch and real-time data processing solutions to support enterprise analytics and reporting requirements.
• Develop and maintain ETL/ELT pipelines using modern cloud-native data engineering practices.
• Work with structured and unstructured data sources, relational and non-relational databases, and API-based integrations.
• Partner with architects and engineering teams to evaluate functional and non-functional requirements and implement scalable data solutions.
• Build and maintain reliable, fault-tolerant, and highly available data platforms and processing frameworks.
• Implement DevOps and DataOps best practices including CI/CD automation, configuration management, monitoring, and deployment pipelines.
• Leverage Databricks, Spark, Kafka, and cloud-native services to process large-scale datasets efficiently.
• Develop and integrate RESTful APIs and data services to enable seamless data accessibility.
• Collaborate on quality engineering practices to ensure the data platform remains secure, scalable, resilient, and performant.
• Monitor and troubleshoot production issues, support incident management processes, and contribute to root cause analysis activities.
• Work with ServiceNow and other operational support tools to manage incidents, requests, and platform stability.
• Contribute to continuous improvement initiatives, automation opportunities, and platform modernization efforts.
• Ensure adherence to security, governance, compliance, and enterprise data management standards.

Expertise You'll Bring:

• 6 to 10 years of experience in Data Engineering and cloud-based data platform development.
• Strong hands-on experience working with Azure or AWS cloud platforms.
• 5+ years of experience with Databricks and Apache Kafka.
• Hands-on experience with Apache Spark and distributed data processing technologies.
• Experience designing and implementing Snowflake-based data solutions and analytical platforms.
• Strong understanding of ETL/ELT frameworks, data ingestion, data transformation, and data orchestration processes.
• Experience working with relational and non-relational databases in enterprise environments.
• Working knowledge of RESTful APIs, microservices integration, and cloud-native application architectures.
• Experience implementing CI/CD pipelines, DevOps practices, and automation frameworks.
• Understanding of Data as a Service (DaaS) and container-based deployment models.
• Knowledge of software engineering best practices including reliability engineering, deployment planning, fault tolerance, and test automation.
• Familiarity with ServiceNow and incident management processes.
• Experience working within Agile/Scrum development environments.
• Strong analytical, troubleshooting, and problem-solving capabilities.
• Excellent communication, collaboration, and stakeholder management skills.
• Ability to work effectively with globally distributed teams and enterprise-scale data ecosystems.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

"Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind."