Data Engineer_Azure Databricks + Snowflake + SQL Developer

Zorba AI; Gurugram District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Zorba AI is seeking an experienced Azure Databricks/Snowflake Developer to design and maintain robust data pipelines in a scalable cloud environment. You will transform large datasets using PySpark and SQL, while optimizing Snowflake schemas and data models for performance and governance.

The role focuses on ETL/ELT, data quality, and collaboration with analysts and architects to deliver enterprise data solutions with Delta Lake and Databricks notebooks.

Qualifications

• Experience with Azure Databricks, Snowflake and SQL.
• Strong data warehousing and ETL concepts.
• Analytical and troubleshooting skills.
• Ability to work independently and with cross-functional teams.

Responsibilities

• Develop and maintain data pipelines using Azure Databricks.
• Build data transformations using PySpark and SQL.
• Design and optimize Snowflake databases, tables, views, and data models.
• Develop complex SQL queries, stored procedures, CTEs, and analytical queries.
• Implement ETL/ELT processes for structured and semi-structured data.
• Work with Delta Lake and Databricks notebooks/jobs.
• Perform data cleansing, validation, transformation, and quality checks.
• Optimize Snowflake queries and warehouse performance.
• Work with large volumes of data and troubleshoot data pipeline issues.
• Collaborate with business analysts, data architects, and other engineering teams.
• Monitor production pipelines and resolve performance or data-related issues.
• Follow best practices for security, data governance, and development standards.

Skills

Azure Databricks

Snowflake

Advanced SQL

PySpark

ETL/ELT

Data Warehousing

Delta Lake

Data Pipeline Development

Tools

Azure Data Factory

Azure Data Lake Storage

Python

Snowflake Streams & Tasks

Snowflake Snowpipe

Git / CI-CD

Azure DevOps

Data modelling

Job description

• Develop and maintain data pipelines using Azure Databricks.

We are looking for an experienced Azure Databricks / Snowflake Developer with strong expertise in SQL, data engineering, ETL/ELT, and cloud data platforms. The candidate will be responsible for developing scalable data pipelines, transforming large datasets, and implementing data solutions using Azure Databricks and Snowflake.

Key Responsibilities

• Develop and maintain data pipelines using Azure Databricks.
• Build data transformations using PySpark and SQL.
• Design and optimize Snowflake databases, tables, views, and data models.
• Develop complex SQL queries, stored procedures, CTEs, and analytical queries.
• Implement ETL/ELT processes for structured and semi-structured data.
• Work with Delta Lake and Databricks notebooks/jobs.
• Perform data cleansing, validation, transformation, and quality checks.
• Optimize Snowflake queries and warehouse performance.
• Work with large volumes of data and troubleshoot data pipeline issues.
• Collaborate with business analysts, data architects, and other engineering teams.
• Monitor production pipelines and resolve performance or data-related issues.
• Follow best practices for security, data governance, and development standards.

Mandatory Skills

• Azure Databricks
• Snowflake
• Advanced SQL
• PySpark
• ETL/ELT
• Data Warehousing
• Delta Lake
• Data Pipeline Development

Good to Have

• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS Gen2)
• Python
• Snowflake Streams & Tasks
• Snowflake Snowpipe
• Git / CI-CD
• Azure DevOps
• Data modelling

Candidate Profile

• Strong hands-on experience with Azure Databricks, Snowflake, and SQL.
• Good understanding of data warehousing and ETL concepts.
• Strong analytical and troubleshooting skills.
• Ability to work independently and collaborate with cross-functional teams.
• Experience working with large-scale enterprise data platforms.

Skills: snowflake,pyspark,data bricks,sql,azure