Azure Databricks Engineer

Persistent; Pune District, Chennai District, Bengaluru; Hybrid; INR 1,200,000 - 2,400,000; Full time

Benefits offered by this job

Hybrid work model

Professional development support

Health benefits

Job summary

Persistent is seeking an experienced Azure Databricks Engineer to design and deliver scalable data pipelines on Azure. You will work with Databricks, Snowflake, and Azure services to enable high-performance analytics, governance, and data quality across cross-functional teams.

The role focuses on building robust ETL/ELT workflows, optimizing SQL/Python queries, and collaborating with stakeholders to translate requirements into reliable data solutions. Hybrid work options are available.

Qualifications

• 4–10 years of Data Engineering experience.
• Hands-on Azure Databricks and PySpark expertise.
• Extensive Snowflake experience for data modeling and ETL/ELT.
• Strong SQL and Python proficiency.
• Experience with Azure Data Factory, Data Lake, Synapse.
• Understanding of data warehousing and pipeline architecture.
• CI/CD experience with Git and Azure DevOps.

Responsibilities

• Design scalable data pipelines using Azure Databricks (PySpark).
• Build and maintain ETL/ELT workflows for large-scale data.
• Develop and optimize Snowflake queries for analytics.
• Integrate pipelines with Azure services (ADF, ADLS, Synapse).
• Design Snowflake data warehouse structures and pipelines.
• Tune Spark jobs and Snowflake workloads for performance.
• Implement data quality, governance, and monitoring.
• Collaborate with stakeholders to gather requirements.
• Troubleshoot data pipelines and production issues.

Skills

Azure Databricks

PySpark

Snowflake

SQL

Python

Azure Data Factory

Azure Data Lake (ADLS)

Azure Synapse

CI/CD (Git, Azure DevOps)

Tools

Git

Azure DevOps

Job description

About Position:

We are looking for an experienced Azure Data Engineer with strong expertise in Databricks, Snowflake, and ETL/ELT pipeline development. The candidate will be responsible for building scalable, high-performance data solutions on Azure to support analytics and business use cases.The ideal candidate will work closely with cross-functional teams to design and deliver high-performance, reliable, and data-driven solutions, while ensuring data quality, efficiency, and scalability within the Azure ecosystem.

• Role: Azure Databricks Engineer
• Location: Bangalore, Pune & Chennai
• Experience: 4 to 10 Years
• Job Type: Full Time Employment

What You'll Do:

• Design and develop scalable data pipelines using Azure Databricks (PySpark)
• Build and maintain robust ETL/ELT workflows for large-scale data processing
• Develop and optimize complex SQL queries in Snowflake for analytics and reporting
• Integrate data pipelines using Azure services such as ADF, ADLS, and Synapse
• Design and manage Snowflake data warehouse structures (tables, views, pipelines)
• Perform performance tuning of Spark jobs and Snowflake workloads
• Implement data quality, validation, governance, and monitoring mechanisms
• Collaborate with business stakeholders to gather requirements and deliver data solutions
• Troubleshoot and resolve data pipeline and production issues

Expertise You'll Bring:

• 4 to 10 years of experience in Data Engineering
• Strong hands-on experience with Azure Databricks and PySpark
• Extensive experience with Snowflake (data modeling, optimization, ETL/ELT pipelines)
• Strong proficiency in SQL and Python
• Experience with Azure services: Data Factory (ADF), Data Lake (ADLS), Synapse
• Solid understanding of data warehousing, ETL processes, and pipeline architecture
• Experience with version control and CI/CD tools (Git, Azure DevOps)

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalisation for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

Let's unleash your full potential at Persistent - persistent.com/careers

Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.