Senior Data Engineer – Azure & Databricks Lead

Nestlé Purina North America; St. Louis (MO); On-site; USD 138,000 - 188,000; Full time

Benefits offered by this job

401k with company match

Healthcare coverage

Bonus eligibility

Job summary

The role emphasizes hands-on engineering, mentorship, and setting standards for data operations, governance, and reusable data assets. Strong Azure, Databricks, and PySpark skills are required to succeed.

Qualifications

• Bachelor’s degree required.
• 7+ years of professional experience with 5+ years in hands-on data engineering.
• 4+ years of experience in Azure ecosystem.
• 4+ years of experience with Databricks and Python/PySpark.

Responsibilities

• Serve as the technical lead for a data product team focused on a specific data domain.
• Develop, test, deploy, and maintain data pipelines to move, transform, and harmonize source data into data products ready for consumption by end users, applications, and other data product teams.
• Ensure adherence to Purina’s data engineering and architectural standards.
• Monitor performance of data pipelines developed and owned within the assigned data domain.
• Champion the adoption of best practices within the data engineering guild.
• Coach and mentor other data engineers.
• Collaborate with other engineers and architects to mature the data enterprise data platform.
• Collaborate with product owners and business stakeholders to develop long-term data product roadmaps.
• Collaborate with stakeholders and data product team to define data product requirements.

Skills

Databricks

Python/PySpark

Azure

Education

Bachelor’s degree from an accredited college or university

Tools

Azure

Databricks

Python/PySpark

Job description

The role emphasizes hands-on engineering, mentorship, and setting standards for data operations, governance, and reusable data assets. Strong Azure, Databricks, and PySpark skills are required to succeed.