Data Engineer

Hr Services Chandigarh; Delhi; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Hr Services Chandigarh seeks a Data Engineer for a leading chemical manufacturing plant in India. You will design, build, and maintain scalable data platforms enabling analytics, AI, and Industry 4.0 initiatives, collaborating with data scientists, software engineers, and plant operations teams.

You will develop ETL/ELT pipelines, integrate diverse data sources, and build data lakes/warehouses on Azure Databricks, ensuring data quality and security.

Qualifications

• B.Tech/M.Tech in Computer Science, Data Engineering, or a related field.
• 3+ years of experience in Data Engineering.
• Experience working in manufacturing, industrial, energy, or supply chain environments is preferred.
• Hands-on experience designing and deploying data platforms.

Responsibilities

• Design and implement scalable data architecture and pipelines.
• Build and maintain ETL/ELT pipelines using Python and SQL.
• Integrate data from SAP, Historian systems, Excel, APIs, and other sources.
• Develop and optimize data lakes and warehouses on Azure/Databricks.
• Ensure data quality, governance, security, and performance.
• Develop Power BI dashboards for KPI tracking and business reporting.
• Provide clean and structured datasets for analytics and AI/ML projects.
• Build and maintain data solutions on Microsoft Azure.
• Manage CI/CD pipelines using Azure DevOps.
• Support batch and real-time data processing using Azure Data Factory, Spark, or Kafka.
• Work with data scientists, full-stack developers, and plant teams to deliver data-driven solutions.
• Support business users by enabling effective reporting and dashboard adoption.
• Contribute to digital transformation initiatives and promote data engineering best practices.

Skills

Python

SQL

Pandas

Spark

Microsoft Azure

Power BI

Azure Data Factory

Airflow

Azure Databricks

PostgreSQL

MS SQL Server

MongoDB

Azure DevOps

Education

B.Tech/M.Tech in Computer Science, Data Engineering, or a related field

Tools

Azure Data Factory

Airflow

Azure Databricks

PostgreSQL

MS SQL Server

MongoDB

Azure DevOps

Job description

Job Description: Data Engineer

About the Role

We are looking for a Data Engineer to join our Digital Transformation team at a leading chemical manufacturing plant in India. In this role, you will design, build, and maintain scalable data platforms that enable analytics, AI, and Industry 4.0 initiatives. You will work closely with data scientists, software engineers, and plant operations teams to develop reliable data infrastructure and business dashboards.

Key Responsibilities

Data Engineering & Architecture

• Design and implement scalable data architecture and pipelines.
• Build and maintain ETL/ELT pipelines using Python and SQL.
• Integrate data from SAP, Historian systems, Excel, APIs, and other sources.
• Develop and optimize data lakes and warehouses on Azure/Databricks.
• Ensure data quality, governance, security, and performance.

Analytics & Visualization

• Develop Power BI dashboards for KPI tracking and business reporting.
• Provide clean and structured datasets for analytics and AI/ML projects.

Cloud & DevOps

• Build and maintain data solutions on Microsoft Azure.
• Manage CI/CD pipelines using Azure DevOps.
• Support batch and real-time data processing using tools such as Azure Data Factory, Spark, or Kafka.

Collaboration

• Work with data scientists, full-stack developers, and plant teams to deliver data-driven solutions.
• Support business users by enabling effective reporting and dashboard adoption.
• Contribute to digital transformation initiatives and promote data engineering best practices.

Required Qualifications

• B.Tech/M.Tech in Computer Science, Data Engineering, or a related field.
• 3+ years of experience in Data Engineering.
• Experience working in manufacturing, industrial, energy, or supply chain environments is preferred.
• Hands-on experience designing and deploying data platforms.

Technical Skills

• Programming: Python, SQL, Pandas, Spark
• Visualization: Power BI
• Cloud: Microsoft Azure
• Data Engineering: Azure Data Factory, Airflow (or similar ETL tools), Azure Databricks
• Databases: PostgreSQL, MS SQL Server, MongoDB or other NoSQL databases
• DevOps: Azure DevOps (CI/CD)

Preferred Skills

• Experience with real-time data processing and streaming technologies.
• Understanding of data governance and data quality best practices.
• Strong problem-solving, communication, and stakeholder management skills.
• Experience supporting Industry 4.0 or digital transformation initiatives is a plus.

PLEASE NOTE THIS IS NOT A WFH OR HYBRID JOB, ITS A WFO JOB ( 5 DAYS)