Senior Azure Data Engineer

Persistent Systems Limited; Goa; Hybrid; INR 1,800,000 - 3,200,000; Full time

Benefits offered by this job

Hybrid work

Education sponsorship

Long service awards

Flexible work hours

Medical insurance

Group term life

Personal accident coverage

Mediclaim hospitalization

Job summary

Persistent Systems Limited is seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data platforms using Azure, Databricks, Snowflake, and related technologies. You will collaborate with architects, analysts, and engineers to deliver robust cloud-based data solutions for healthcare outcomes and business decision-making.

The role requires 6–10 years in Data Engineering with strong Azure, Databricks, Kafka, and Spark experience.

Qualifications

• 6–10 years of data engineering experience.
• 6+ years with Azure and/or AWS.
• 5+ years with Azure Databricks and Apache Kafka.
• Snowflake Data Cloud experience.
• Strong Spark-based processing knowledge.
• Experience designing ETL/ELT pipelines.
• Experience with RESTful APIs.
• Experience with relational and non-relational databases.
• Familiar with Agile and DevOps practices.
• Bachelor's degree in Engineering/CS/IT or equivalent.

Responsibilities

• Collaborate with stakeholders to deliver solutions aligned with agile roadmaps.
• Design, develop, test, and maintain large-scale data pipelines.
• Build data solutions using Azure, Databricks, Spark, and cloud-native technologies.
• Develop data integrations between relational and non-relational databases.
• Implement APIs and data services for enterprise applications.
• Establish CI/CD, DevOps practices in the development lifecycle.
• Set up monitoring, logging, and observability for data platforms.
• Support production environments and troubleshoot data issues.

Skills

Analytical thinking

Problem-solving

Communication skills

Education

Bachelor's degree

Tools

Azure Databricks

Apache Kafka

Snowflake

Spark

RESTful APIs

SQL databases

CI/CD

ServiceNow

Job description

We are an AI-led, platform-driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry-leading organizations across the world, including 20 Fortune 50 companies and 4 of the 5 top banks in both the US and India, and numerous innovators across the healthcare ecosystem.

As an Azure Data Engineer, you will be part of a highly skilled team focused on building scalable and modern data solutions that help improve healthcare outcomes and business decision-making. You will collaborate with architects, product owners, analysts, and engineering teams to design, develop, and maintain robust cloud-based data platforms using Azure, Databricks, Snowflake, and related technologies.

• Location: All Persistent Locations
• Experience: 6 to 10 Years
• Job Type: Full Time Employment

What You’ll Do:

• Collaborate with product owners, business analysts, architects, and software engineers to deliver solutions aligned with agile roadmaps.
• Design, develop, test, and maintain large-scale data-intensive applications and data pipelines.
• Build and optimize data solutions using Azure services, Databricks, Spark, and cloud-native technologies.
• Develop and maintain data integrations between relational and non-relational databases.
• Design and implement APIs and data services to support enterprise applications.
• Work closely with architects to evaluate functional and non-functional requirements and deliver high-quality solutions.
• Follow and enhance CI/CD, DevOps, and automation practices within the development lifecycle.
• Build and maintain deployment pipelines using configuration management and automation tools.
• Implement monitoring, logging, and observability solutions for data platforms.
• Apply software engineering best practices including reliability engineering, fault-tolerant design, deployment planning, and automated testing.
• Work with Data-as-a-Service (DaaS) and Container-as-a-Service (CaaS) architectures.
• Manage and resolve incidents using ticketing systems such as ServiceNow.
• Collaborate on quality assurance strategies to ensure data platforms are scalable, secure, resilient, and accurate.
• Support production environments and troubleshoot complex data engineering issues.

Expertise You’ll Bring:

• 6 to 10 years of overall experience in Data Engineering and cloud platform development.
• 6+ years of experience working with Azure and/or AWS cloud services.
• 5+ years of hands-on experience with Azure Databricks and Apache Kafka.
• Strong experience building and optimizing Spark-based data processing solutions.
• 2+ years of experience working with Snowflake Data Cloud.
• Experience in designing and developing scalable ETL/ELT pipelines.
• Working knowledge of RESTful APIs and integration frameworks.
• Experience with relational databases such as SQL Server, Oracle, or PostgreSQL.
• Experience with non-relational databases and modern data storage technologies.
• Strong understanding of distributed data processing and big data concepts.
• Experience with Agile development methodologies and DevOps practices.
• Familiarity with CI/CD pipelines, version control systems, and infrastructure automation.
• Experience with monitoring, logging, and observability tools.
• Exposure to ServiceNow or similar incident management platforms.
• Strong analytical, problem-solving, and communication skills.
• Bachelor's degree in Engineering, Computer Science, Information Technology, or equivalent experience.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”