Senior Data Engineer: Databricks, Spark & Python Expert

84.51˚; Chicago (IL); On-site; USD 98,000 - 169,050; Full time

Benefits offered by this job

Health insurance

401(k) with matching

Paid time off

Maternity/Paternity leave

Company holidays

Job summary

84.51° is a full stack data science, insights and media company focused on turning retail data into actionable shopper experiences. We work with Kroger and partners, deploying Databricks, PySpark, Python and Java across scalable cloud platforms.

As a data developer you will ingest, store and distribute large data sets using Databricks, Spark, JSON and SQL in Scrum teams, contributing to product tooling and new features for the business.

Qualifications

• 3+ years proven ability of professional data development experience.
• 3+ years proven ability of developing with Databricks.
• 3+ years of experience with PySpark/Spark.
• 3+ years of experience developing with either Python or Java.
• Full understanding of ETL concepts and data warehousing concepts.
• Experience with pipeline orchestration.
• Experience with CI/CD.
• Experience with version control software.
• Strong understanding of Agile principles (Scrum).
• Bachelor’s degree in Computer Science, MIS, Mathematics, Business Analytics, or STEM.

Responsibilities

• Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC.
• Participate in the design and development of Databricks and cloud‑based solutions.
• Implement automated unit and integration testing.
• Collaborate with architecture and lead engineers to ensure consistent development practices.
• Provide mentoring to junior engineers.
• Participate in retrospective reviews.
• Participate in the estimation process for new work and releases.
• Collaborate with other engineers to solve and bring new perspectives to complex problems.
• Drive improvements in data engineering practices, procedures, and ways of working.
• Embrace new technologies and an ever‑changing environment.

Skills

Databricks

PySpark

Python

Java

ETL concepts

CI/CD

Version control

Agile/Scrum

Data warehousing

Education

Bachelor's degree in CS / MIS / Math / Business Analytics / STEM

Tools

Azure

Delta Lake

Delta Live Tables

AKS / Kubernetes / Helm

Terraform

GitHub Actions

Databricks

Tableau / Power BI

Kafka

Job description

84.51° is a full stack data science, insights and media company focused on turning retail data into actionable shopper experiences. We work with Kroger and partners, deploying Databricks, PySpark, Python and Java across scalable cloud platforms.

As a data developer you will ingest, store and distribute large data sets using Databricks, Spark, JSON and SQL in Scrum teams, contributing to product tooling and new features for the business.