Senior Expert Data Engineer- Procurement

dsm-firmenich; Hyderabad; On-site; INR 3,000,000 - 4,200,000; Full time

Benefits offered by this job

Growth opportunities

Collaborative culture

Global team

Job summary

dsm-firmenich Hyderabad is seeking a Lead Expert Data Engineer-Procurement to design and maintain robust data pipelines and lead a team driving data integration across procurement initiatives.

You will collaborate with data modelers, business partners, and SMEs to deliver scalable, quality data solutions while adhering to best practices and automation. This role emphasizes deployment and governance in a science-led, global environment.

Qualifications

• Expert knowledge in dbt, SQL, Python, Spark (PySpark), Git, Azure DevOps and Databricks.
• 5 years of experience in creating and maintaining data pipelines. Experience with cheminformatics or bioinformatics is a plus.
• Experience with FAIR data principles, data governance, and collaborating with SMEs to ensure seamless data integration.

Responsibilities

• Provide technical recommendations and evaluate project feasibility and workloads.
• Design and implement efficient pipeline architectures for data ingestion, transformation, and storage.
• Develop modular, efficient code for data transformation and integration, ensuring adherence to modern development practices.
• Perform data ingestion from source systems, including ETL processes, when tables are not available on the data platform
• Conduct regular pipeline maintenance and upgrades, troubleshooting and resolving issues to ensure optimal performance.
• Implement data quality testing (automatic) and validation to maintain high standards of data integrity and reliability.
• Collaborate closely with other data engineers, data modelers, data stewards, BI developers, data scientists, and SMEs to ensure seamless data integration and delivery of impactful solutions.

Skills

dbt

SQL

Python

Spark

Git

Azure DevOps

Databricks

Tools

Databricks

Azure

CI/CD pipelines

ETL tooling

Job description

Job Role-Lead Expert Data Engineer-Procurement

Location-Hyderabad

At dsm-firmenich we strive to achieve a world where you don't have to choose between taste, texture, or health - and can enjoy it all. Our innovative ingredients, expertise, and solutions bridge the gap between the delicious, the nutritious, and the sustainable.

In this role you will design, maintain robust data pipeline and manage team, projects/initiatives ensuring seamless data integration and transformation. Collaborate with data modelers and business partners to drive impactful projects centered around our data.

At dsm-firmenich, being a force for good is not optional. Diversity, Equity & Inclusion is a shared responsibility woven into our daily work, benefiting our People, Customers & Communities and driving business value. Equal access to opportunities is a given, belonging is a shared feeling, authenticity is celebrated.

Your Key Responsibilities

• Provide technical recommendations and evaluate project feasibility and workloads.
• Design and implement efficient pipeline architectures for data ingestion, transformation, and storage.
• Develop modular, efficient code for data transformation and integration, ensuring adherence to modern development practices.
• Perform data ingestion from source systems, including ETL processes, when tables are not available on the data platform
• Conduct regular pipeline maintenance and upgrades, troubleshooting and resolving issues to ensure optimal performance.
• Implement data quality testing (automatic) and validation to maintain high standards of data integrity and reliability.
• Collaborate closely with other data engineers, data modelers, data stewards, BI developers, data scientists, and subject matter experts to ensure seamless data integration, knowledge sharing, and delivery of impactful solutions.

We Bring

• Unique career paths across health, nutrition and beauty, explore what drives you and get the support to make it happen
• A chance to impact millions of consumers every day, sustainability embedded in all we do.
• A science led company, cutting edge research and creativity everywhere, from biotech breakthroughs to sustainability game-changers, you'll work on what’s next.
• Growth that keeps up with you, you join an industry leader that will develop your expertise and leadership.
• A culture that lifts you up. with collaborative teams, shared wins, and people who cheer each other on.
• A community where your voice matters. it is essential to serve our customers well.

You Bring

• Expert knowledge in dbt, SQL, Python, Spark (PySpark), Git, Azure DevOps and Databricks.
• Expertise in cloud engineering (e.g., AWS, Azure); experience with infrastructure-as-code is a plus, and deploying CI/CD pipelines is a must.
• 5 years of experience in creating and maintaining data pipelines. Experience handling scientific datasets for cheminformatics or bioinformatics (e.g., microbiome) is a plus.
• Experience with FAIR data principles, data governance, and data standards commonly used in scientific domains. Ability to collaborate closely with data experts and SMEs to ensure seamless data integration and transformation.
• Consistent application of best practices in coding, testing and documentation, delivering scalable and reliable data solutions with automated quality checks and monitoring tools.
• Curiosity and a growth mindset, always asking "Is there a better way?" to leverage data for smarter decision-making. Strong focus on deployment development and automation,

About dsm-firmenich:

At dsm-firmenich, we don't just meet expectations – we go beyond them. Join our global team powered by science, creativity, and a shared purpose: to bring progress to life. From elevating health to making fortified food and sustainable skincare, the impact of your work here will be felt by millions – every single day. Whether it's fragrance that helps you focus, alternative meat that’s better for the planet, or reducing sugar without losing flavor, this is where you help shape the future of nutrition, health, and beauty for everyone, everywhere. And while you're making a difference, we'll make sure you're growing too. With learning that never stops, a culture that lifts you up and the freedom to move across businesses, teams, and borders. Your voice matters here. And your ideas? they're essential to our future. Because real progress only happens when we go beyond, together.

Inclusion, belonging and equal opportunity statement:

At dsm-firmenich, we believe being a force for good starts with the way we treat each other.

When people feel supported, included, and free to be themselves,