Senior Data Engineer (Individual Contributor)

N Human Resources & Management Systems; Dehradun; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

N. Human Resources & Management Systems is seeking a Senior Data Engineer in Dehradun. The role focuses on designing scalable ETL/ELT pipelines, building data solutions with Azure Databricks, and optimizing Spark and ADL pipelines.

Responsibilities include working with Azure Synapse, Delta Lake, and Medallion architecture, ensuring high-performance data processing, and collaborating with cross-functional teams to deliver enterprise data solutions.

Qualifications

• Design and develop scalable ETL/ELT pipelines.
• Build data solutions using Azure Databricks and PySpark.
• Develop and optimize Azure Data Factory pipelines.
• Work with Azure Synapse Analytics and ADLS Gen2.
• Implement Delta Lake and Medallion Architecture.

Responsibilities

• Design and develop scalable ETL/ELT pipelines.
• Build data solutions using Azure Databricks and PySpark.
• Develop and optimize Azure Data Factory pipelines.
• Work with Azure Synapse Analytics and ADLS Gen2.
• Implement Delta Lake and Medallion Architecture.
• Optimize Spark jobs for performance and scalability.
• Collaborate with technical teams to deliver enterprise data solutions.

Skills

Azure Databricks

ADF

ADLS Gen2

Azure Synapse

PySpark

Python

SQL

Spark SQL

Delta Lake

ETL/ELT Development

Tools

Microsoft Fabric

Unity Catalog

Airflow

Kafka

Snowflake

Job description

Job Title: Senior Data Engineer

Location: Dehradun (Hybrid)

Experience: 6–10 Years

Key Responsibilities

• Design and develop scalable ETL/ELT pipelines.
  
• Build data solutions using Azure Databricks and PySpark.
  
• Develop and optimize Azure Data Factory pipelines.
  
• Work with Azure Synapse Analytics and ADLS Gen2.
  
• Implement Delta Lake and Medallion Architecture.
  
• Optimize Spark jobs for performance and scalability.
  
• Collaborate with technical teams to deliver enterprise data solutions.
  

Required Skills

• Azure Databricks
  
• Azure Data Factory (ADF)
  
• ADLS Gen2
  
• Azure Synapse
  
• PySpark
  
• Python
  
• SQL
  
• Spark SQL
  
• Delta Lake
  
• ETL/ELT Development
  

Preferred Skills

• Microsoft Fabric
  
• Unity Catalog
  
• Airflow
  
• Kafka
  
• Snowflake