Data Engineer_Azure Databricks + Snowflake + SQL Developer

Zorba AI; Maharashtra; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Zorba AI in Maharashtra is seeking an experienced Azure Databricks / Snowflake Developer to design and implement scalable data pipelines on Azure Databricks and Snowflake. You will transform large datasets using PySpark and SQL, build data models, and optimize warehouse performance.

You will collaborate with data architects and analysts to deliver robust data solutions, ensure data quality, governance, and security, and participate in CI/CD for data projects using typical tooling.

Qualifications

• Proven experience with Azure Databricks and Snowflake.
• Strong SQL, PySpark, and ETL/ELT skills.
• Experience in data warehousing and Delta Lake concepts.
• Ability to design scalable data pipelines for large datasets.
• Familiarity with data governance and security best practices.

Responsibilities

• Develop and maintain data pipelines using Azure Databricks.
• Build data transformations using PySpark and SQL.
• Design and optimize Snowflake databases, tables, views, and data models.
• Develop complex SQL queries, stored procedures, CTEs, and analytics queries.
• Implement ETL/ELT processes for structured and semi-structured data.
• Work with Delta Lake and Databricks notebooks/jobs.
• Perform data cleansing, validation, transformation, and quality checks.
• Optimize Snowflake queries and warehouse performance.
• Collaborate with business analysts, data architects, and other engineering teams.
• Monitor production pipelines and resolve performance or data-related issues.
• Follow best practices for security, data governance, and development standards.

Skills

Azure Databricks

Snowflake

Advanced SQL

PySpark

ETL/ELT

Data Warehousing

Delta Lake

Data Pipeline Development

Tools

Azure Data Factory

Azure Data Lake Storage

Snowflake Streams & Tasks

Snowflake Snowpipe

Git / CI-CD

Azure DevOps

Job description

• Develop and maintain data pipelines using Azure Databricks.

We are looking for an experienced Azure Databricks / Snowflake Developer with strong expertise in SQL, data engineering, ETL/ELT, and cloud data platforms. The candidate will be responsible for developing scalable data pipelines, transforming large datasets, and implementing data solutions using Azure Databricks and Snowflake.

Key Responsibilities

• Develop and maintain data pipelines using Azure Databricks.
• Build data transformations using PySpark and SQL.
• Design and optimize Snowflake databases, tables, views, and data models.
• Develop complex SQL queries, stored procedures, CTEs, and analytical queries.
• Implement ETL/ELT processes for structured and semi-structured data.
• Work with Delta Lake and Databricks notebooks/jobs.
• Perform data cleansing, validation, transformation, and quality checks.
• Optimize Snowflake queries and warehouse performance.
• Work with large volumes of data and troubleshoot data pipeline issues.
• Collaborate with business analysts, data architects, and other engineering teams.
• Monitor production pipelines and resolve performance or data-related issues.
• Follow best practices for security, data governance, and development standards.

Mandatory Skills

• Azure Databricks
• Snowflake
• Advanced SQL
• PySpark
• ETL/ELT
• Data Warehousing
• Delta Lake
• Data Pipeline Development

Good to Have

• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS Gen2)
• Python
• Snowflake Streams & Tasks
• Snowflake Snowpipe
• Git / CI-CD
• Azure DevOps
• Data modelling

Candidate Profile

• Strong hands-on experience with Azure Databricks, Snowflake, and SQL.
• Good understanding of data warehousing and ETL concepts.
• Strong analytical and troubleshooting skills.
• Ability to work independently and collaborate with cross-functional teams.
• Experience working with large-scale enterprise data platforms.

Skills: snowflake,pyspark,data bricks,sql,azure