Senior Data Engineer: Cloud Data Platforms & Databricks

Talentify; Boise (ID); On-site; USD 100,000 - 150,000; Full time

Job summary

Simplot, a Boise-based leader in food and agriculture, is seeking a Data Engineer III to advance cloud data platforms, develop scalable pipelines with SQL, Python, and PySpark, and mentor teammates. The role emphasizes collaboration with analytics and business units to deliver robust data solutions.

The position involves building scalable data solutions using Databricks, Azure services, and modern lakehouse architectures while contributing to CI/CD and IaC practices in a fast-paced environment.

Qualifications

• Bachelor's degree in CS/IT/Engineering or related field.
• 5+ years data engineering experience and/or training.
• Strong proficiency in SQL for data transformation and modeling.
• Proficient in Python and PySpark; experience with Databricks.
• Familiar with Azure cloud services and IaC tools like Terraform.

Responsibilities

• Participates as a member of a data engineering team responsible for cloud data platforms.
• Mentors and guides other engineers.
• Designs, builds, and maintains data pipelines and transformations using SQL, Python, and PySpark.
• Designs, prepares and executes manual and/or automated test plans and scripts.
• Leverages advanced data engineering expertise to perform routine and complex maintenance, optimization, and production support.
• Collaborates effectively with business, analytics, and technical teams to drive alignment and trust in data solutions.
• Demonstrates technical leadership and exerts influence beyond the immediate team.
• Design, implement, and manage CI/CD pipelines for automated software delivery.
• Build and maintain infrastructure as code (IaC) solutions using tools like Terraform.
• Support the release process by working closely with engineering teams to improve deployment speed and reliability.
• Maintain documentation on new and existing implementations and practices.
• Present and train the data engineering organization on innovations, best practices, and implementations.

Skills

SQL

Python

PySpark

Databricks

Azure DevOps

Data Modeling

Terraform

Git

Agile Methodologies

Communication Skills

Education

Bachelor's degree in CS/IT/Engineering

Tools

Azure Data Lake

Gradle

CloudFormation

Ansible

FastAPI

Shiny

Streamlit

Job description

Simplot, a Boise-based leader in food and agriculture, is seeking a Data Engineer III to advance cloud data platforms, develop scalable pipelines with SQL, Python, and PySpark, and mentor teammates. The role emphasizes collaboration with analytics and business units to deliver robust data solutions.

The position involves building scalable data solutions using Databricks, Azure services, and modern lakehouse architectures while contributing to CI/CD and IaC practices in a fast-paced environment.