Lead Expert Data Engineer- Procurement

dsm-firmenich; Hyderabad; On-site; INR 2,800,000 - 4,500,000; Full time

Benefits offered by this job

Career growth opportunities

Global company exposure

Collaborative culture

Impact millions of consumers

Job summary

dsm-firmenich is seeking a Lead Expert Data Engineer for Procurement to design and maintain robust data pipelines in aHyderabad-based environment. You will lead a team, manage projects, and drive data integration across source systems and datasets.

The role emphasizes modern development practices, automation, data quality checks, and collaboration with data scientists, SMEs, and business partners to deliver impactful data solutions within a science-driven company.

Qualifications

• 5+ years of experience creating and maintaining data pipelines.
• Experience handling scientific datasets for cheminformatics or bioinformatics is a plus.
• Knowledge of FAIR data principles, data governance and data standards used in scientific domains.

Responsibilities

• Provide technical recommendations and evaluate project feasibility and workloads.
• Design and implement efficient pipeline architectures for data ingestion, transformation, and storage.
• Develop modular, efficient code for data transformation and integration, ensuring adherence to modern development practices.
• Perform data ingestion from source systems, including ETL processes, when tables are not available on the data platform.
• Conduct regular pipeline maintenance and upgrades, troubleshooting and resolving issues to ensure optimal performance.
• Implement data quality testing (automatic) and validation to maintain high standards of data integrity and reliability.
• Collaborate closely with other data engineers, data modelers, data stewards, BI developers, data scientists, and SMEs to ensure seamless data integration and delivery of impactful solutions.

Skills

dbt

SQL

Python

Spark / PySpark

Git

Azure DevOps

Databricks

AWS & Azure

CI/CD pipelines

Data pipelines

Tools

Databricks

Azure

AWS

Job description

Job Role-Lead Expert Data Engineer-Procurement

Location-Hyderabad

At dsm-firmenich we strive to achieve a world where you don't have to choose between taste, texture, or health - and can enjoy it all. Our innovative ingredients, expertise, and solutions bridge the gap between the delicious, the nutritious, and the sustainable.

In this role you will design, maintain robust data pipeline and manage team, projects/initiatives ensuring seamless data integration and transformation. Collaborate with data modelers and business partners to drive impactful projects centered around our data.

At dsm-firmenich, being a force for good is not optional. Diversity, Equity & Inclusion is a shared responsibility woven into our daily work, benefiting our People, Customers & Communities and driving business value. Equal access to opportunities is a given, belonging is a shared feeling, authenticity is celebrated.

Your Key Responsibilities

• Provide technical recommendations and evaluate project feasibility and workloads.
• Design and implement efficient pipeline architectures for data ingestion, transformation, and storage.
• Develop modular, efficient code for data transformation and integration, ensuring adherence to modern development practices.
• Perform data ingestion from source systems, including ETL processes, when tables are not available on the data platform
• Conduct regular pipeline maintenance and upgrades, troubleshooting and resolving issues to ensure optimal performance.
• Implement data quality testing (automatic) and validation to maintain high standards of data integrity and reliability.
• Collaborate closely with other data engineers, data modelers, data stewards, BI developers, data scientists, and subject matter experts to ensure seamless data integration, knowledge sharing, and delivery of impactful solutions.

We Bring

• Unique career paths across health, nutrition and beauty, explore what drives you and get the support to make it happen
• A chance to impact millions of consumers every day, sustainability embedded in all we do.
• A science led company, cutting edge research and creativity everywhere, from biotech breakthroughs to sustainability game-changers, you'll work on what's next.
• Growth that keeps up with you, you join an industry leader that will develop your expertise and leadership.
• A culture that lifts you up. with collaborative teams, shared wins, and people who cheer each other on.
• A community where your voice matters. it is essential to serve our customers well.

You Bring

• Expert knowledge in dbt, SQL, Python, Spark (PySpark), Git, Azure DevOps and Databricks.
• Expertise in cloud engineering (e.g., AWS, Azure); experience with infrastructure-as-code is a plus, and deploying CI/CD pipelines is a must.
• 5 years of experience in creating and maintaining data pipelines.Experience handling scientific datasets for cheminformatics or bioinformatics (e.g., microbiome) is a plus.
• Experience with FAIR data principles, data governance, and data standards commonly used in scientific domains.Ability to collaborate closely with data experts and SMEs to ensure seamless data integration and transformation.
• Consistent application of best practices in coding, testing and documentation, delivering scalable and reliable data solutions with automated quality checks and monitoring tools.
• Curiosity and a growth mindset, always asking \"Is there a better way?\" to leverage data for smarter decision-making.Strong focus on deployment development and automation,

About dsm-firmenich:

At dsm-firmenich, we don't just meet expectations - we go beyond them. Join our global team powered by science, creativity, and a shared purpose: to bring progress to life. From elevating health to making fortified food and sustainable skincare, the impact of your work here will be felt by millions - every single day. Whether it's fragrance that helps you focus, alternative meat that's better for the planet, or reducing sugar without losing flavor, this is where you help shape the future of nutrition, health, and beauty for everyone, everywhere. And while you're making a difference, we'll make sure you're growing too. With learning that never stops, a culture that lifts you up and the freedom to move across businesses, teams, and borders. Your voice matters here. And your ideas? They're essential to our future. Because real progress only happens when we go beyond, together.

Inclusion, belonging and equal opportunity statement:

At dsm-firmenich, we believe being a force for good starts with the way we treat each other.

When people feel supported, included, and free to be themselves, they do their best work - and that's exactly the kind of culture we're building.

A place where opportunity is truly equal, authenticity is celebrated, and everyone has the chance to grow, contribute, and feel they belong.

We're proud to be an equal opportunity employer, and we're serious about making our hiring process as fair and inclusive as possible.

From inclusive language and diverse interview panels to thoughtful sourcing, we're committed to reflecting the world we serve.

We welcome candidates from all backgrounds - no matter your gender, ethnicity, sexual orientation, or anything else that makes you, you.

And if you have a disability or need any support through the application process, we're here to help - just let us know what you need, and we'll do everything we can to make it work.