Senior Data Engineer

Vserve; Coimbatore District; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

VSERVE EBUSINESS SOLUTIONS INDIA PRIVATE LIMITED is seeking a Senior Data Engineer in Coimbatore to design, build, and own scalable data platforms on Microsoft Azure. The role focuses on EDW, ETL/ELT pipelines, and analytics‑ready data models for retail, wholesale, and distribution clients.

The ideal candidate will lead cloud‑native pipeline architecture, work with business stakeholders to translate requirements into production‑grade data solutions.

Qualifications

• Must have 5+ years of hands‑on data engineering and ownership of end‑to‑end pipelines.
• Strong experience with Azure data services: ADF, Databricks, Azure SQL.
• Hands‑on Spark/PySpark and Delta Lake for large‑scale processing.
• Proven ability to build and orchestrate pipelines with Airflow or equivalent.
• Advanced SQL and Python (Pandas, NumPy) coding.
• Experience with Power BI or Microsoft Fabric for reporting.

Responsibilities

• Design, build, and maintain scalable EDW solutions on Azure.
• Develop and orchestrate end‑to‑end ETL/ELT pipelines with Airflow and ADF.
• Build PySpark transformations and Delta Lake pipelines for analytics datasets.
• Design dimensional models and data marts for sales, inventory, and profitability reporting.
• Develop Power BI models and dashboards for KPI reporting.
• Implement data quality, validation, and reconciliation frameworks.

Skills

Azure Data Factory

Databricks

PySpark

SQL

Python

Power BI

Delta Lake

Education

Bachelor's degree in CS/IT

Master's degree

Tools

Airflow

Delta Lake

GitHub Actions

Job description

Full time | VSERVE EBUSINESS SOLUTIONS INDIA PRIVATE LIMITED | India

Posted On 09/07/2026

Job Information

E-Commerce/Supply Chain Management

City Coimbatore

State/Province Tamil Nadu

641004

Job Description

Location - India (Coimbatore preferred)

Work Mode - WFO preferred, hybrid or remote will also be considered for the right candidate

Experience - 5+ years in Data Engineering, including hands‑on cloud data platform delivery

Employment Type - Full-Time

ROLE OVERVIEW

Vserve is looking for a Senior Data Engineer to design, build, and own scalable data platforms on Microsoft Azure ecosystems. This role will lead the development of Enterprise Data Warehousing, ETL/ELT pipelines, and analytics‑ready data models that power reporting and decision‑making for our retail, wholesale, and distribution clients. The ideal candidate is equally comfortable architecting cloud‑native pipelines and partnering directly with business stakeholders to translate requirements into reliable, production‑grade data solutions.

KEY RESPONSIBILITIES

• Design, build, and maintain scalable Enterprise Data Warehouse (EDW) solutions on Azure (ADF, Databricks, Azure SQL, Microsoft Fabric).
• Develop and orchestrate end‑to‑end ETL/ELT pipelines using Apache Airflow, Azure Data Factory, and Databricks, ensuring reliability and minimal manual intervention.
• Build and optimize PySpark transformations and Delta Lake pipelines to process large‑scale datasets into curated, analytics‑ready data products.
• Design dimensional data models (star/snowflake schemas), fact and dimension tables, and data marts to support sales, inventory, demand, and profitability reporting.
• Develop Power BI semantic models, datasets, and interactive dashboards enabling self‑service analytics and KPI reporting for business stakeholders.
• Implement data quality and validation frameworks, including reconciliation checks, exception reporting, and automated alerting.
• Own data reconciliation between ERP/business systems (e.g., Microsoft Dynamics AX / D365 F&O, POS platforms) and the enterprise data warehouse.
• Implement complex business logic for margin calculations, cost attribution, and promotional/discount allocation to
• Build automated data ingestion frameworks using Python and REST APIs, and implement incremental loading strategies for efficient, near real‑time reporting.
• Tune and optimize SQL/PL‑SQL queries and data workflows for performance across high‑volume, regulated, or
• Implement CI/CD for data pipelines (GitHub Actions, Git) to improve release consistency and reduce deployment
• Partner with business users, analysts, and SMEs to gather requirements and translate them into scalable, well‑documented data engineering solutions.
• Mentor junior data engineers and contribute to data architecture and engineering best practices across the team.

CANDIDATE PROFILE — SKILLS & EXPERIENCE

Must‑Have

• 5+ years of hands‑on Data Engineering experience, with demonstrated ownership of production data pipelines end to end.
• Strong experience with Microsoft Azure data services: Azure Data Factory (ADF), Databricks, Azure Data
• Hands‑on expertise in Apache Spark / PySpark and Delta Lake for large‑scale data processing.
• Proven experience building and orchestrating pipelines with Apache Airflow or equivalent workflow orchestration tools.
• Advanced SQL skills and solid Python (Pandas, NumPy) programming ability.
• Experience with Power BI (DAX, Power Query) and/or Microsoft Fabric for reporting and dashboard delivery.
• Experience implementing data quality, validation, and reconciliation frameworks in a production

Good‑to‑Have

• Exposure to Microsoft Dynamics AX / Dynamics 365 Finance & Operations (D365 F&O) or similar ERP/POS
• Experience with Informatica PowerCenter or other enterprise ETL tools.
• Familiarity with MongoDB, PostgreSQL, or DynamoDB alongside relational/warehouse platforms.
• Experience in retail, wholesale distribution, or financial services data domains.
• Working knowledge of CI/CD practices (GitHub Actions, Git) and Agile delivery methodologies.
• Prior experience mentoring engineers or leading a small data engineering pod.

Education

• Bachelor degree in Computer Science, Information Technology, or a related field is required.
• Master degree is a plus.

Requirements