Data Engineer_Azure Databricks + Snowflake + SQL Developer

Zorba AI; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Zorba AI in Hyderabad seeks an experienced Azure Databricks / Snowflake Developer to design and maintain data pipelines, transform large datasets, and implement data solutions on Azure Databricks and Snowflake.

You will build PySpark transformations, optimize Snowflake structures, and ensure data quality, governance, and scalable performance while collaborating with analysts and engineers in a fast-paced cloud data environment.

Qualifications

• Proficient in Azure Databricks, Snowflake and SQL for scalable data pipelines.
• Experience with PySpark and ETL/ELT across large datasets.
• Strong understanding of data warehousing concepts and data modeling.
• Ability to work with Delta Lake and Databricks notebooks.

Responsibilities

• Develop and maintain data pipelines using Azure Databricks.
• Build data transformations with PySpark and SQL.
• Design and optimize Snowflake databases, tables, views, and models.
• Develop complex SQL queries, stored procedures, and analytical queries.
• Implement ETL/ELT processes for structured and semi-structured data.
• Monitor pipelines and troubleshoot performance or data issues.
• Collaborate with analysts, architects, and other engineers.
• Follow data governance, security, and development best practices.

Skills

Azure Databricks

Snowflake

Advanced SQL

PySpark

ETL/ELT

Data Warehousing

Delta Lake

Data Pipeline Development

Tools

Azure Data Factory

ADLS Gen2

Python

Snowflake Streams & Tasks

Snowflake Snowpipe

Git / CI-CD

Azure DevOps

Data modelling

Job description

• Develop and maintain data pipelines using Azure Databricks.

We are looking for an experienced Azure Databricks / Snowflake Developer with strong expertise in SQL, data engineering, ETL/ELT, and cloud data platforms. The candidate will be responsible for developing scalable data pipelines, transforming large datasets, and implementing data solutions using Azure Databricks and Snowflake.

Key Responsibilities

• Develop and maintain data pipelines using Azure Databricks.
• Build data transformations using PySpark and SQL.
• Design and optimize Snowflake databases, tables, views, and data models.
• Develop complex SQL queries, stored procedures, CTEs, and analytical queries.
• Implement ETL/ELT processes for structured and semi-structured data.
• Work with Delta Lake and Databricks notebooks/jobs.
• Perform data cleansing, validation, transformation, and quality checks.
• Optimize Snowflake queries and warehouse performance.
• Work with large volumes of data and troubleshoot data pipeline issues.
• Collaborate with business analysts, data architects, and other engineering teams.
• Monitor production pipelines and resolve performance or data-related issues.
• Follow best practices for security, data governance, and development standards.

Mandatory Skills

• Azure Databricks
• Snowflake
• Advanced SQL
• PySpark
• ETL/ELT
• Data Warehousing
• Delta Lake
• Data Pipeline Development

Good to Have

• Azure Data Factory (ADF)
• Azure Data Lake Storage (ADLS Gen2)
• Python
• Snowflake Streams & Tasks
• Snowflake Snowpipe
• Git / CI-CD
• Azure DevOps
• Data modelling

Candidate Profile

• Strong hands-on experience with Azure Databricks, Snowflake, and SQL.
• Good understanding of data warehousing and ETL concepts.
• Strong analytical and troubleshooting skills.
• Ability to work independently and collaborate with cross-functional teams.
• Experience working with large-scale enterprise data platforms.

Skills: snowflake,pyspark,data bricks,sql,azure