CPW Data Engineer II

General Mills; Mumbai; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

CPW in Mumbai is seeking a Senior Data Engineer to build high-quality data assets and scalable ETL/ELT pipelines using Azure Databricks and PySpark. You will design Bronze-Silver-Gold architectures, enforce data governance, and integrate diverse datasets for robust BI solutions.

We expect 7+ years in data engineering, strong SQL/PySpark skills, and experience with Delta Lake and data warehousing. FMCG familiarity is a plus; collaboration with stakeholders is essential.

Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Electronics and Telecommunications, or related field.
• 7+ years of relevant experience in Data Engineering.
• Mandatory experience with data lakes and multiple data sources.
• Strong hands-on experience with SQL, PySpark, Azure Databricks, Azure Data Factory.
• Knowledge of data warehousing concepts, ETL frameworks, and BI platforms.
• Experience with Delta Lake architecture and large-scale data processing.
• Strong understanding of data modeling, data integration, and data quality principles.
• Good communication and stakeholder-management skills.

Responsibilities

• Build high-quality data assets that provide a competitive advantage.
• Develop and maintain robust ETL/ELT pipelines using Azure Databricks and PySpark.
• Design and maintain Bronze, Silver, and Gold data-layer architectures.
• Implement incremental processing, deduplication, data validation, and performance optimization.
• Establish and maintain data governance and stewardship practices, including data quality, security, validation metrics, and accurate data flow.
• Integrate data from multiple sources, including Nielsen, Circana, internal systems, panel data, RMS data, and other relevant datasets.
• Develop scalable data models to support reporting, analytics, and business intelligence use cases.
• Ensure consistency across product, period, market, and other business hierarchies.
• Review existing data models and processes to identify sustainable, scalable, and automated approaches.
• Harmonize data and processes while maintaining an effective balance between speed, quality, and business needs.
• Partner with stakeholders and internal teams to understand data requirements and deliver timely solutions to business questions.
• Support reporting and visualization teams with backend data architecture and data model development.
• Optimize queries, Delta storage formats, pipelines, workflows, scalability, and cost efficiency.
• Identify and resolve data-quality issues and proactively address data opportunities.

Skills

SQL

PySpark

Azure Databricks

Azure Data Factory

Delta Lake

Data modeling

Data integration

Data quality

Data warehousing

Stakeholder management

SQL optimization

Education

Bachelor's degree in CS/IT/ET

Master's preferred

Tools

Azure Databricks

Azure Data Factory

Delta Lake

Job description

Company Overview

We exist to make food the world loves. But we do more than that. Our company is a place that prioritizes being a force for good, a place to expand learning, explore new perspectives and reimagine new possibilities, every day. We look for people who want to bring their best — bold thinkers with big hearts who challenge one another and grow together. Because becoming the undisputed leader in food means surrounding ourselves with people who are hungry for what’s next.

Company Overview

We exist to make food the world loves. But we do more than that. Our company is a place that prioritizes being a force for good, a place to expand learning, explore new perspectives and reimagine new possibilities, every day. We look for people who want to bring their best — bold thinkers with big hearts who challenge one another and grow together. Because becoming the undisputed leader in food means surrounding ourselves with people who are hungry for what’s next.

Overview

Cereal Partners Worldwide (CPW) is a joint venture between General Mills and Nestlé, two of the world’s leading food organizations. Working at CPW offers the best of both worlds: the scale and capabilities of large organizations combined with the agility and entrepreneurial spirit of a smaller company. CPW builds cutting-edge capabilities, sets industry benchmarks, partners with technology start-ups, implements advanced processes, and creates strong technical and analytical foundations. This is an opportunity to learn, grow, and contribute to an exciting, data-driven team.

Key Accountabilities

• Build high-quality data assets that provide a competitive advantage.


• Develop and maintain robust ETL/ELT pipelines using Azure Databricks and PySpark.


• Design and maintain Bronze, Silver, and Gold data-layer architectures.


• Implement incremental processing, deduplication, data validation, and performance optimization.


• Establish and maintain data governance and stewardship practices, including data quality, security, validation metrics, and accurate data flow.


• Integrate data from multiple sources, including Nielsen, Circana, internal systems, panel data, RMS data, and other relevant datasets.


• Develop scalable data models to support reporting, analytics, and business intelligence use cases.


• Ensure consistency across product, period, market, and other business hierarchies.


• Review existing data models and processes to identify sustainable, scalable, and automated approaches.


• Harmonize data and processes while maintaining an effective balance between speed, quality, and business needs.


• Partner with stakeholders and internal teams to understand data requirements and deliver timely solutions to business questions.


• Support reporting and visualization teams with backend data architecture and data model development.


• Optimize queries, Delta storage formats, pipelines, workflows, scalability, and cost efficiency.


• Identify and resolve data-quality issues and proactively address data opportunities.


• Maintain strong working relationships with peers and contribute effectively as a team member.

Minimum Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Electronics and Telecommunications, or a related field.


• Minimum 7 years of relevant experience in Data Engineering.


• Mandatory experience working with data lakes and multiple data sources.


• Strong hands-on experience with - SQL, PySpark, Azure Databricks, Azure Data Factory.


• Knowledge of data warehousing concepts, ETL frameworks, and business intelligence platforms.


• Experience with Delta Lake architecture and large-scale data processing.


• Strong understanding of data modeling, data integration, and data quality principles.


• Good communication and stakeholder-management skills.

Preferred Skills

• Master’s degree in Computer Science, Information Technology, Electronics and Telecommunications, or a related field.


• Experience in the FMCG industry.


• Experience developing business intelligence platforms or 360-degree data views.


• Experience with Nielsen, Circana, panel data, RMS data, or similar consumer and market datasets.


• Experience with Azure Storage Accounts, Azure Key Vault, and Azure DevOps.


• Familiarity with data governance, data security, and stewardship frameworks.


• Strong focus on data accuracy, reliability, and attention to detail.


• Ability to manage ambiguous data issues and drive timely resolution.


• Continuous-improvement and ownership mindset.


• Ability to lead change, make quality decisions, and deliver results within established timelines.


• Curiosity and willingness to learn new tools, technologies, and functional capabilities.


• Ability to build strong peer relationships, collaborate effectively, and positively influence others.

ELIGIBILITY

Applicants must meet minimum age qualifications in the country in which the job is located.