Senior Data Engineer: Databricks & Spark Expert

8451; Cincinnati (OH); On-site; USD 98,000 - 169,050; Full time

Benefits offered by this job

Health insurance

401(k) with Roth option

Health Savings Account

Paid time off (5 weeks)

Job summary

84.51° is seeking a data developer to ingest, store, and distribute big data using Python, Databricks, Spark, JSON, and SQL in agile teams. You will own features end-to-end, collaborate with architects and engineers, and contribute to automated testing and code quality across cloud-based data platforms.

The role emphasizes data engineering best practices, mentoring teammates, and actively driving improvements while embracing evolving technologies within the Kroger ecosystem.

Qualifications

• 3+ years of professional Data Development experience.
• 3+ years developing with Databricks.
• 3+ years of PySpark/Spark experience.
• 3+ years developing with Python or Java.
• Strong ETL and Data Warehousing understanding.
• Experience with Pipeline Orchestration.
• Experience with CI/CD and version control.
• Familiarity with Agile/Scrum practices.
• Bachelor’s Degree in a relevant field.

Responsibilities

• Own features and drive them through all SDLC phases.
• Design and develop Databricks and cloud-based solutions.
• Implement automated unit and integration tests.
• Collaborate with architects and senior engineers on best practices.
• Mentor junior engineers and share knowledge.
• Participate in retrospectives and planning.
• Contribute to data engineering process improvements.
• Adopt new technologies and adapt to changing requirements.

Skills

Databricks

PySpark

Python/Java

ETL Concepts

Data Warehousing

CI/CD

Git

Agile/Scrum

Bachelor's Degree

Education

Bachelor’s Degree (CS, MIS, Math, Business Analytics, or STEM)

Tools

Azure

Databricks Delta Tables

Delta Lake

Delta Live Tables

Kubernetes

Helm

Terraform

Power BI/Tableau

FastAPI/Flask

AKS

Job description

84.51° is seeking a data developer to ingest, store, and distribute big data using Python, Databricks, Spark, JSON, and SQL in agile teams. You will own features end-to-end, collaborate with architects and engineers, and contribute to automated testing and code quality across cloud-based data platforms.

The role emphasizes data engineering best practices, mentoring teammates, and actively driving improvements while embracing evolving technologies within the Kroger ecosystem.