Senior Data Engineering Manager - T&T

McCormick & Company, Incorporated; Gurgaon; On-site; INR 2,800,000 - 6,000,000; Full time

Job summary

McCormick & Company, Incorporated is seeking a Data Engineering Manager to lead a team of 8–10 engineers in building and maintaining scalable data pipelines and data products. You will align with business units to deliver data-driven analytics, AI, and reporting solutions, ensuring data quality, security, and performance across multi-source systems.

The role emphasizes collaboration with Data Science, ML, and Analytics teams, driving process improvements and cost optimization while mentoring a

Qualifications

• Bachelor's degree in Mathematics, Statistics, Computer Science, Data Analytics/Science, or related field; Masters in technical field or MBA a plus.
• 10+ years of data engineering experience.
• Demonstrated ability coding in one or more languages (PySpark preferred).
• Experience with data visualization software (Power BI preferred).
• Experience with building data pipelines.
• Experience with knowledge graphs.
• Demonstrated ability to manage multiple priorities simultaneously.
• Knowledge of data analysis, visualization techniques, and frameworks.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Experience with the following tooling: OR GCP BigQuery, FiveTran, GCP Cloud Composer, GCP DLP (Data Loss Prevention), GCP Cloud Run, Vertex AI etc

Responsibilities

• Lead, mentor, and develop a high-performing team of 8-10 data engineers.
• Define technical standards, code review practices, and engineering excellence frameworks.
• Build career paths, upskilling programs, and succession plans within data engineering.
• Foster a culture of innovation, accountability, collaboration, and continuous learning.
• Be accountable for building a winning data engineering team – driven by making data a core asset for McCormick.
• Collaborate with data product managers to gather data product requirements.
• Design end-to-end solutions including data security, data quality and performance requirements.
• Prepare documentation and with data product managers to define the implementation plan.
• Implement ELT pipelines to efficiently ingest and transform data from a wide variety of data sources and deliver datasets that meet business requirements.
• Ensure efficient and reliable data mapping to support business needs.
• Deliver complete documentation and knowledge transfer sessions for the Team and business partners.
• Maintain existing solutions, implement optimizations and enhancements, monitor data quality.
• Develop and maintain scalable data pipelines leveraging Azure Synapse, PySpark, APIs, and SQL & performing advanced data cleaning, transformation, and manipulation to ensure high-quality, and reliable data flows.
• Collaborate with Data Science, ML and Business Analytics teams to optimize performance and cost effectiveness of their analytics solutions.
• Identify and design internal process improvements, including automating manual processes, optimizing data delivery, and redesigning solutions for enhanced scalability.
• Design and implement existing solution adjustments to improve performance and cost-effectiveness.
• Suggest and introduce best practices for Data and AI engineering.
• Assist stakeholders with data-related technical issues and support their data needs.
• Work with the Analytics Operational Support team to investigate, troubleshoot, and resolve data errors / discrepancies.
• Provide expert-level support and guidance to data teams across the Enterprise.

Skills

PySpark

Power BI

Data modeling

ETL/ELT design

Leadership

Data governance

Problem solving

Mentoring

Education

Bachelor's degree in Mathematics, Statistics, Computer Science, Data Analytics/Science, or related field

Masters degree a plus

Tools

Azure Synapse

SQL

GCP BigQuery

FiveTran

GCP Cloud Composer

Vertex AI

Databricks

Job description

Select how often (in days) to receive an alert:

You may know McCormick as a leader in herbs, spices, seasonings, and condiments – and we’re only getting started. At McCormick, we’re always looking for new people to bring their unique flavor to our team.

McCormick employees – all 14,000 of us across the world – are what makes this company a great place to work.

Position Summary:

As a Data Engineering Manager at McCormick, you will play a pivotal role in the build and delivery of data products from simple to complex and supporting McCormick business units with their data and analytics needs.

Your responsibilities will include leading a team that delivers and supports data for existing analytics solutions, tooling, and solutions, researching new features and implementing automations. You will support business users, Data Scientists and Data Analysts to convert business expectations into data products and data models usable by business to deliver AI, analysis, reporting, and data-driven recommendations to stakeholders and executives.

This role will be accountable for building and maintaining scalable data pipelines from source systems. The Data Engineering Manager will ensure the availability, reliability, and performance of data products by integrating raw data from various sources. Key responsibilities include data modeling, ETL (Extract, Transform, Load) development, and ensuring data quality and security. This role will be accountable for data coming in from 5+ source systems.

Key Responsibilities:

Plan and Design

• Collaborate with data product managers to gather data product requirements.
• Design end-to-end solutions including data security, data quality and performance requirements.
• Prepare documentation and with data product managers to define the implementation plan.

Data Extraction, Load and Transformation

• Implement ELT pipelines to efficiently ingest and transform data from a wide variety of data sources and deliver datasets that meet business requirements.
• Ensure efficient and reliable data mapping to support business needs.
• Deliver complete documentation and knowledge transfer sessions for the Team and business partners.
• Maintain existing solutions, implement optimizations and enhancements, monitor data quality.
• Develop and maintain scalable data pipelines leveraging Azure Synapse, PySpark, APIs, and SQL & performing advanced data cleaning, transformation, and manipulation to ensure high-quality, and reliable data flows.

Process Improvement, Performance and Cost optimization tuning

• Collaborate with Data Science, Machine Learning and Business Analytics teams to optimize performance and cost effectiveness of their analytics solutions.
• Identify and design internal process improvements, including automating manual processes, optimizing data delivery, and redesigning solutions for enhanced scalability. Work with Azure Analytics Product Owner to prioritize and schedule implementation.
• Design and implement existing solution adjustments to improve performance and cost-effectiveness.
• Suggest and introduce best practices for Data and AI engineering.

Issue Resolution and Support

• Assist stakeholders with data-related technical issues and support their data needs. Work with the Analytics Operational Support team to investigate, troubleshoot, and resolve data errors / discrepancies.
• Provide expert-level support and guidance to data teams across the Enterprise.

People Leadership & Capability Building

• Lead, mentor, and develop a high-performing team of 8-10 data engineers.
• Define technical standards, code review practices, and engineering excellence frameworks.
• Build career paths, upskilling programs, and succession plans within data engineering.
• Foster a culture of innovation, accountability, collaboration, and continuous learning.
• Be accountable for building a winning data engineering team – driven by making data a core asset for McCormick.

Desired Candidate Profile:

• Bachelor’s degree in Mathematics, Statistics, Computer Science, Data Analytics/Science, or related field; Masters in technical field or MBA a plus
• or Microsoft Certified: Fabric Data Engineer Associate or related cloud technologies, Fabric IQ/databricks certifications a plus
• 10+ years of data engineering experience.
• Demonstrated ability coding in one or more languages (PySpark preferred).
• Experience with data visualization software (Power BI preferred).
• Experience with building data pipelines.
• Experience with knowledge graphs.
• Demonstrated ability to manage multiple priorities simultaneously.
• Knowledge of data analysis, visualization techniques, and frameworks.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Experience with the following tooling:
• OR
• GCP BigQuery, FiveTran, GCP Cloud Composer, GCP DLP (Data Loss Prevention), GCP Cloud Run, Vertex AI etc

At McCormick, we have over a 100-year legacy based on our “Power of People” principle. This principle fosters an unusually dedicated workforce requiring a culture of respect, recognition, inclusion and collaboration based on the highest ethical value

WHY WORK AT MCCORMICK?

As a McCormick employee you’ll be empowered to focus on more than your individual responsibilities. You’ll have the opportunity to be part of something bigger than yourself—to have a say in where the company is going and how it’s growing.

Between our passion for flavor, our 130-year history of leadership and integrity, the competitive and comprehensive benefits we offer, and our culture, which is built on respect and opportunities for growth, there are many reasons to join us at McCormick.