Senior Data engineer

AiQMEN; Dadri; On-site; INR 600,000 - 1,200,000; Full time

Job summary

AiQMEN in Dadri is seeking a data engineering professional passionate about data modeling and eager to collaborate with engineers and data scientists. In this role, you will lead gap analysis and source-to-target mapping, set up pipeline infrastructure, and create detailed documentation. Expertise in data modeling, AWS Glue, Redshift, and strong teamwork skills are essential. Join us for a steep learning curve in the dynamic world of data engineering. Apply at [e-mail].

Qualifications

• Proven expertise in data modelling and pipeline development.
• Proficient in ER Studio, STTM, AWS Glue, Redshift, and Athena.
• Strong communication, documentation, and teamwork skills.

Responsibilities

• Lead Gap Analysis and Source-to-Target Mapping exercises.
• Set up pipeline infrastructure and build pipelines.
• Create comprehensive documentation for each task.

Skills

Data modelling

AWS Glue

Redshift

SAP data environments

DevOps

Agile (Azure ADO)

Logistics experience

Communication skills

Documentation skills

Teamwork skills

Tools

ER Studio

STTM

Athena

Power BI

Job description

What are we looking for :

We are seeking an energetic and passionate data engineering professional with a strong interest in data modelling and data engineering, eager to thrive in a collaborative environment. In this role, you will work closely with a team of engineers and data scientists dedicated to delivering business value. If you enjoy a steep learning curve, expanding your knowledge, and growing in the dynamic world of data engineering and AI, this is an excellent opportunity.

What skills you must possess :

• Proven expertise in data modelling, pipeline development, and
• Proficient in ER Studio, STTM, AWS Glue, Redshift, Athena, and Power
• Skilled in SAP data environments, DevOps, and Agile (Azure ADO).
• Domain experience in Logistics, Supply Planning, Exports, and IFOT.
• Strong communication, documentation, and teamwork skills.

Key Responsibilities:

1. Data Modelling

• Lead Gap Analysis and Source-to-Target Mapping exercises.
• Analyse EA extract and map SAP sources to AWS Transform, Conform, and Enrich Zones.
• Create a matrix of reports to identify missing SAP fields/tables in the Transform Zone.
• Collaborate with SMEs to finalise the Data Model and obtain email confirmation and approval.
• Perform data modelling (ER Studio, STTM) and generate DDL scripts for implementation.

2. Data Engineering

• Set up pipeline infrastructure (Glue Jobs, crawlers, scheduling, step functions, etc.).
• Build, deploy, test, and run pipelines in lower environments.
• Verify data integrity (no duplicates, complete columns).
• Write unit tests and apply code formatting/linting.
• Collaborate with Modelling Engineers to align approaches.
• Update existing CZ pipelines (e.g., SDLF) with new columns for EZ tables.
• Raise DDP requests to register databases/tables and load data into the raw zone.

3. Others

• Create comprehensive good documentation. Ensure each task is accompanied by detailed notes specific to its functional area for clear tracking and reference.
• Analyse and manage bugs and change requests raised by business/SMEs.
• Collaborate with Data Analysts and Virtual Engineers (VE) to refine and enhance semantic modelling in Power BI.
• Plan out work using Microsoft Azure, ADO. Dependencies, status and effort are correctly reflected.

So, are you the one? Let us know @ [e-mail] Thank you! Recruitment team @ AiQMEN