Senior Data Engineer

Nisum; India; On-site; INR 1,000,000 - 1,500,000; Full time

Benefits offered by this job

Continuous Learning Training Sessions

Parental Medical Insurance

Team-building Activities

Free Meals

Job summary

A leading IT consulting company in India is seeking a Mid-Senior Level Data Engineer to design, develop, and maintain data pipelines using Azure Data Services. The ideal candidate should have over 10 years of experience with Microsoft Azure, strong Python proficiency, and hands-on experience with tools like Azure Databricks. The position involves ensuring data quality, implementing CI/CD practices, and collaborating with cross-functional teams. Competitive salary and various employee benefits are included.

Qualifications

• 10+ years of experience with Microsoft Azure, including Data Lake Storage, Data Factory, and Synapse Analytics.
• Proficient in Python for data engineering and hands-on experience with Databricks.
• Experience with relational databases and NoSQL stores.

Responsibilities

• Design and maintain scalable data pipelines using Azure Data Services.
• Build ETL/ELT pipelines with Azure Databricks.
• Ensure data quality, validation, and governance standards.

Skills

Microsoft Azure

Python

PySpark

SQL

Data Engineering Concepts

CI/CD pipelines

Education

Bachelor’s degree in computer science, Information Systems, Engineering, Computer Applications

Tools

Azure Data Factory

Azure Databricks

Git

Job description

What You'll Do

• Design, develop, and maintain scalable, reliable, and high-performance data pipelines using Azure Data Services
• Build and optimise ETL/ELT pipelines using Azure Databricks (PySpark)
• Ingest, transform, and process structured and unstructured data from multiple data sources
• Implement data models to support analytics, reporting, and machine learning use cases
• Ensure data quality, data validation, and governance standards are met
• Optimise performance and cost for large-scale data processing workloads
• Integrate data pipelines with downstream systems such as Power BI, data science models, and enterprise applications
• Collaborate with cross‑functional teams, including Data Science, Analytics, DevOps, and Product
• Implement CI/CD pipelines for data workloads and follow DevOps best practices
• Support production deployments and troubleshoot data pipeline issues

What You Know

Cloud & Data Platforms

• 10+ Years strong experience with Microsoft Azure, including:
  • Azure Data Lake Storage (ADLS Gen2)
  • Azure Data Factory (ADF)
  • Azure Synapse Analytics
• Hands‑on experience with Azure Databricks

Programming & Frameworks

• Strong proficiency in Python for data engineering
• Hands‑on experience with PySpark / Spark SQL
• Experience working with notebooks, jobs, and workflows in Databricks

Databases & Storage

• Experience with relational databases (Azure SQL, SQL Server, PostgreSQL)
• Experience with NoSQL / big data stores (Delta Lake, Cosmos DB preferred)
• Strong SQL skills for data transformation and optimisation

Data Engineering Concepts

• Strong understanding of data warehousing, lakehouse architecture, and distributed systems
• Experience implementing Delta Lake, partitioning, indexing, and performance tuning
• Knowledge of batch and near‑real‑time data processing

DevOps & Engineering Practices

• Experience with CI/CD pipelines (Azure DevOps preferred)
• Familiarity with version control (Git)
• Exposure to infrastructure as code (ARM / Terraform – good to have)
• Understanding of monitoring, logging, and alerting for data platforms

Good to Have

• Experience with streaming platforms (Kafka, Azure Event Hubs, or Spark Structured Streaming)
• Exposure to data governance, security, and compliance frameworks
• Experience supporting ML pipelines and feature engineering
• Power BI or other BI tool integration experience

Education

• Bachelor’s degree in computer science, Information Systems, Engineering, Computer Applications, or related field.

Benefits

• In addition to competitive salaries and benefits packages, Nisum India offers its employees some unique and fun extras:
• Continuous Learning – Year‑round training sessions are offered as part of skill enhancement certifications sponsored by the company on an as‑needed basis. We support our team to excel in their field.
• Parental Medical Insurance – Nisum believes our team is the heart of our business, and we want to make sure to take care of the heart of theirs. We offer opt‑in parental medical insurance in addition to our medical benefits.
• Activities – From the Nisum Premier League’s cricket tournaments to hosting a Hack‑a‑thon, Nisum employees can participate in a variety of team‑building activities, such as skits, dance performance in addition to festival celebrations.
• Free Meals – Free snacks and dinner are provided daily, in addition to subsidised lunch.

Seniority level

• Mid‑Senior level

Employment type

• Full‑time

Job function

• Information Technology

Industries

• IT Services and IT Consulting