Lead Data Engineer - T&T

McCormick & Company; Gurugram District; On-site; INR 2,500,000 - 4,200,000; Full time

Benefits offered by this job

Competitive compensation

Career growth opportunities

Flexibility and support for diverse (l

Diversity and Sustainability awards

Wellbeing programs: physical, mental,财

Job summary

McCormick & Company is hiring a Data Engineer to build and maintain scalable data pipelines and data products across business units. You will work with PySpark, SQL, and modern data platforms to enable AI, analytics, and data-driven decision making.

The role emphasizes data modeling, ETL/ELT development, data quality and security, and collaboration with data scientists and analysts to deliver reliable data flows and insights for executives.

Qualifications

• Bachelor's degree in Mathematics, Statistics, Computer Science, Data Analytics/Science, or related field.
• Experience: 8–12 years engineering in data pipelines and analytics.
• Strong coding in PySpark and SQL; experience with data modeling and ETL/ELT implementations.

Responsibilities

• Build and maintain scalable data pipelines from multiple source systems.
• Deliver data products and support AI, analytics, and reporting needs.
• Implement ETL/ELT processes with data security and quality controls.
• Collaborate with data product managers to capture data requirements and document lineage.
• Improve performance and cost efficiency of data products and pipelines.
• Provide documentation and knowledge transfer to teams and stakeholders.

Skills

PySpark

SQL

Data pipelines

Data quality

Azure Synapse

Databricks

ETL

Education

Bachelor's degree in Mathematics, Statistics, Computer Science, Data Analytics/Science, or related field

Tools

Azure Synapse

Databricks

SQL

Fabric

Azure Data Factory

Azure ML

Azure DevOps

Job description

At McCormick, we bring our passion for flavor to work each day. We encourage growth, respect everyone's contributions and do what's right for our business, our people, our communities and our planet. Join us on our quest to make every meal and moment better.

Founded in Baltimore, MD in 1889 in a room and a cellar by 25-year-old Willoughby McCormick with three employees, McCormick is a global leader in flavour. With over 14,000 employees around the world and more than $6 Billion in annual sales, the Company manufactures, markets, and distributes spices, seasoning mixes, condiments and other flavourful products to the entire food industry, retail outlets, food manufactures, food service businesses and consumers.

While our global headquarters are in the Baltimore, Maryland, USA area, McCormick operates and serves customers from nearly 60 locations in 25 countries and 170 markets in Asia-Pacific, China, Europe, Middle East and Africa, and the Americas, including North, South and Central America

What We Bring To The Table

The best people deserve the best rewards. In addition to the benefits you’d expect from a global leader (401k, health insurance, paid time off, etc.) we also offer:

• Competitive compensation
• Career growth opportunities
• Flexibility and Support for Diverse Life Stages and Choices
• We prioritize our communities and the planet we share. We are proud to be awarded as a Diversity Inc. Top 50 company for Diversity and have multiple Sustainability awards (ranking #22 in the World and #1 in Food Products)
• Wellbeing programs including Physical, Mental and Financial wellness
• Tuition assistance

Position Overview

As a Data Engineer at McCormick, you will play a pivotal role in the build and delivery of data products from simple to complex and supporting McCormick business units with their data and analytics needs.

Your responsibilities will include delivering and supporting data for existing analytics solutions, tooling, and solutions, researching new features and implementing automations. You will support business users, Data Scientists and Data Analysts to convert business expectations into data products and data models usable by business to deliver AI, analysis, reporting, and data-driven recommendations to stakeholders and executives.

This role will be accountable for building and maintaining scalable data pipelines from source systems. The Data Engineer will ensure the availability, reliability, and performance of data products by integrating raw data from various sources. Key responsibilities include data modeling, ETL (Extract, Transform, Load) development, and ensuring data quality and security. This role will be accountable for data coming in from 1-3 source systems.

Key Responsibilities

• Execute
• Collaborate with data product managers to gather data requirement
• Execute ETL solutions including data security, data quality and performance requirements.
• Prepare documentation of data product lineage and all other related ETL topics.
• Data Extraction, Load and Transformation
• Implement and maintain ELT pipelines to efficiently ingest and transform data from a wide variety of data sources and deliver datasets that meet business requirements.
• Ensure efficient and reliable data mapping to support business needs.
• Deliver complete documentation and knowledge transfer sessions for the Team and business partners.
• Maintain existing solutions, implement optimizations and enhancements, monitor data quality.
• Support the development and maintenance of scalable data pipelines leveraging Azure Synapse, PySpark, APIs, and SQL & performing advanced data cleaning, transformation, and manipulation to ensure high-quality, and reliable data flows.
• Process Improvement, Performance and Cost optimization tuning
• Collaborate with Data Science, AI, and Data product teams to optimize performance and cost effectiveness of their solutions.
• Identify and support the design of internal process improvements, including automating manual processes, optimizing data product delivery, and redesigning solutions for enhanced scalability.
• Implement solution adjustments to improve performance and cost-effectiveness of data products.
• Issue Resolution and Support
• Assist stakeholders with data-related product pipeline issues and support their data product needs.
• Work with the Analytics Operational Support team to investigate, troubleshoot, and resolve data errors / discrepancies.

Required Qualifications

Level of Education and Discipline

• Bachelor’s degree in Mathematics, Statistics, Computer Science, Data Analytics/Science, or related field

Certifications and/or Licenses

• Microsoft Certified: Azure Data Engineer Associate (DP-900) or Microsoft Certified: Fabric Data Engineer Associate or related cloud technologies, Fabric IQ/databricks certifications a plus

Experience

• 8-12 years of data engineering experience.
• Demonstrated ability coding in one or more languages (PySpark preferred).
• Experience with building data pipelines.
• Demonstrated ability to manage multiple priorities simultaneously.
• Basic SQL performance tuning.
• Structured + semi-structured data handling.
• Unit testing for pipelines.
• Git-based workflow.
• Exposure to medallion architecture.
• Understanding of data privacy basics.

Interpersonal Skills

• Effective communication skills and ability to communicate effectively on technical and business issues both internally and externally.
• Ability to work independently, navigate problems, resolve conflicts, and bring solutions to the table.
• Build strong interpersonal relationships
• Time management and prioritization skills
• Strong technical curiosity and passion for problem solving and innovation
• Ongoing aspiration to learn about new industry tools

Other Skills & Competencies

• Knowledge of data analysis, visualization techniques, and frameworks.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Experience with the following tooling:
• SQL, Fabric, Databricks, Synapse, Azure Data Factory, Azure ML, Azure DevOps (for CI/CD), OR (Secondary)
• GCP BigQuery, FiveTran, GCP Cloud Composer, GCP DLP (Data Loss Prevention), GCP Cloud Run, Vertex AI etc

At McCormick, we have over a 100-year legacy based on our “Power of People” principle. This principle fosters an unusually dedicated workforce requiring a culture of respect, recognition, inclusion and collaboration based on the highest ethical value