Azure Data Engineer

O2 Breathing Brains; Mumbai; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

O2 Breathing Brains in Mumbai is seeking a Data Engineer to design and implement scalable data pipelines on Azure. You will work with Spark, PySpark, and Scala in Databricks to process large datasets and build a robust data lakehouse using Delta Lake on ADLS Gen2.

The role focuses on creating high-performance data models, SQL pools in Azure Synapse, and a strong emphasis on best-practice data warehousing concepts. DP-203 certification is preferred.

Qualifications

• Experience with Azure Data Factory, Databricks, and Synapse workflows.
• Proficiency in Spark, PySpark, or Scala within Databricks.
• Strong SQL, Python, or Scala programming skills.
• Knowledge of dimensional modeling and data warehousing concepts.
• Preferred Microsoft Certified: Azure Data Engineer Associate (DP-203).

Responsibilities

• Build and maintain scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Synapse Analytics.
• Process large-scale datasets with Spark, PySpark, or Scala in Databricks.
• Implement Medallion Architecture (Bronze/Silver/Gold) using Delta Lake on ADLS Gen2.
• Design and maintain data models and SQL pools in Azure Synapse.

Skills

Azure Data Platform

Databricks Spark

Delta Lake

Synapse SQL

SQL

Python

Scala

Dimensional modeling

Azure DP-203

Job description

Data Engineer

Location: Mumbai

Fulltime

Interview mode: Virtual than F2F

Key Responsibilities

• Pipeline Development: Build and maintain scalable, secure ETL/ELT pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
• Data Processing: Utilize Apache Spark, PySpark, or Scala within Databricks to process large-scale structured and unstructured datasets.
• Data Lakehouse Management: Implement Medallion Architecture (Bronze, Silver, Gold layers) using Delta Lake on Azure Data Lake Storage (ADLS) Gen2.
• Data Warehousing: Design, model, and maintain high-performance data models and SQL pools in Azure Synapse.

Required Skills & Qualifications

• Cloud Platforms: Expert knowledge of Microsoft Azure (ADLS Gen2, Data Factory, Synapse, Databricks).
• Big Data Technologies: Proficiency in Databricks Spark, Delta Lake, and Synapse SQL.
• Programming Languages: Strong proficiency in SQL, Python, or Scala.
• Data Modeling: Expertise in dimensional modeling (star/snowflake schema) and data warehousing concepts.
• Certifications: Preferred certification in Microsoft Certified: Azure Data Engineer Associate (DP-203).