Azure Databricks Engineer

Persistent Systems; Pune District; Hybrid; INR 900,000 - 1,300,000; Full time

Job summary

Persistent Systems is seeking an experienced Azure Data Engineer to build scalable data solutions on Azure, focusing on Databricks, Snowflake, and ETL/ELT pipelines. The role involves collaborating with cross-functional teams to deliver high-performance, reliable data products, ensuring quality and scalability within the Azure ecosystem.

The ideal candidate has 4–10 years in data engineering, deep hands-on Azure Databricks and PySpark experience, Snowflake proficiency, and strong SQL/Python

Qualifications

• 4 to 10 years of Data Engineering experience.
• Hands-on experience with Azure Databricks and PySpark.
• Extensive Snowflake experience for modeling and ETL/ELT pipelines.
• Strong SQL and Python skills.
• Experience with Azure Data Factory, Data Lake, and Synapse.
• Knowledge of data warehousing, CI/CD, and version control practices.

Responsibilities

• Design and develop scalable data pipelines using Azure Databricks (PySpark).
• Build and maintain robust ETL/ELT workflows for large-scale data processing.
• Develop and optimize SQL queries in Snowflake for analytics and reporting.
• Integrate data pipelines using Azure services: ADF, ADLS, Synapse.
• Design and manage Snowflake data warehouse structures.
• Performance-tune Spark jobs and Snowflake workloads.
• Implement data quality, governance, and monitoring mechanisms.
• Collaborate with stakeholders to gather requirements and deliver data solutions.
• Troubleshoot and resolve production data pipeline issues.

Skills

Azure Databricks

PySpark

Snowflake

SQL

Python

Git

Azure DevOps

ETL/ELT pipelines

Tools

Azure Databricks

PySpark

Snowflake

SQL

Python

ADF

ADLS

Synapse

Git

Azure DevOps

Job description

We are looking for an experienced Azure Data Engineer with strong expertise in Databricks, Snowflake, and ETL/ELT pipeline development. The candidate will be responsible for building scalable, high-performance data solutions on Azure to support analytics and business use cases.The ideal candidate will work closely with cross-functional teams to design and deliver high-performance, reliable, and data-driven solutions, while ensuring data quality, efficiency, and scalability within the Azure ecosystem.

• Experience: 4 to 10 Years
• Job Type: Full Time Employment

What You'll Do:

• Design and develop scalable data pipelines using Azure Databricks (PySpark)
• Build and maintain robust ETL/ELT workflows for large-scale data processing
• Develop and optimize complex SQL queries in Snowflake for analytics and reporting
• Integrate data pipelines using Azure services such as ADF, ADLS, and Synapse
• Design and manage Snowflake data warehouse structures (tables, views, pipelines)
• Perform performance tuning of Spark jobs and Snowflake workloads
• Implement data quality, validation, governance, and monitoring mechanisms
• Collaborate with business stakeholders to gather requirements and deliver data solutions
• Troubleshoot and resolve data pipeline and production issues

Expertise You'll Bring:

• 4 to 10 years of experience in Data Engineering
• Strong hands-on experience with Azure Databricks and PySpark
• Extensive experience with Snowflake (data modeling, optimization, ETL/ELT pipelines)
• Strong proficiency in SQL and Python
• Experience with Azure services: Data Factory (ADF), Data Lake (ADLS), Synapse
• Solid understanding of data warehousing, ETL processes, and pipeline architecture
• Experience with version control and CI/CD tools (Git, Azure DevOps)
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let's unleash your full potential at Persistent - persistent.com/careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”