Senior Data Engineer (P1129)

84.51˚; Chicago (IL); On-site; USD 98,000 - 169,000; Full time

Benefits offered by this job

Health benefits

401(k) with company match

Paid time off

Job summary

84.51° is hiring a Senior Data Engineer in Chicago, IL to build scalable data ingestion, transformation, storage, and distribution pipelines for data scientists and products.

You will work with PySpark/Python, Databricks, and cloud-native tools, participate in the SDLC, and mentor junior engineers while embracing new technologies in a fast-paced environment.

Qualifications

• 3+ years proven Data Development experience.
• 3+ years proven Databricks experience.
• 3+ years PySpark/Spark experience.
• 3+ years experience developing with Python or Java.
• Understanding of ETL and Data Warehousing concepts.
• Experience with Pipeline Orchestration.
• Experience with CI/CD and version control.
• Strong grasp of Agile/Scrum principles.
• Understanding of AI concepts and patterns.
• Bachelor’s Degree in Computer Science, MIS, Math, Business Analytics, or STEM.

Responsibilities

• Take ownership of features across the 84.51° SDLC, including internal/external applications and process improvements.
• Design and develop Databricks and cloud-based solutions.
• Implement automated unit and integration tests.
• Collaborate with architects/lead engineers for consistent practices.
• Mentor junior engineers and participate in retrospectives.
• Estimate new work and releases with the team.
• Collaborate to solve complex data problems.
• Drive improvements in data engineering practices and tooling.
• Embrace new technologies and evolving environments.

Skills

Data development

Databricks

PySpark

Python

Java

ETL concepts

Data warehousing

CI/CD

Version control

Agile/Scrum

AI concepts

Education

Bachelor’s Degree in Computer Science/MIS/Math/Business Analytics or STEM

Tools

Databricks Delta Tables

Delta Lake

Delta Live Tables

Azure

Kafka

AKS/Kubernetes/Helm

FastAPI/Flask

Tableau/Power BI

Terraform

GitHub Actions

Job description

84.51° Overview

84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.

Powered by cutting‑edge science, we utilize first‑party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer‑centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.

84.51° follows a 5‑day in‑office work schedule to support collaboration, alignment, and team connection.

Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United States and with the Kroger Family of Companies (i.e. H1‑B visa, F‑1 visa (OPT), TN visa or any other non‑immigrant status).

As a Senior Data Engineer, you will have the opportunity to build solutions that ingest, transform, store, and distribute our big data to be consumed by data scientists and our products.

Our data engineers use PySpark/Python, Databricks, and other data engineering technologies and visualization tools to deliver data capabilities and services to our scientists, products, and tools.

This role will also have exposure to Python microservice development, leveraging FastAPI, Helm, AKS and other Aure based technologies for building and hosting applications at scale.

Responsibilities

• Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes internal and external facing applications as well as process improvement activities:
• Participate in the design and development of Databricks and Cloud‑based solutions
• Implement automated unit and integration testing
• Collaborate with architecture and lead engineers to ensure consistent development practices
• Provide mentoring to junior engineers
• Participate in retrospective reviews
• Participate in the estimation process for new work and releases
• Collaborate with other engineers to solve and bring new perspectives to complex problems
• Drive improvements in data engineering practices, procedures, and ways of working
• Embrace new technologies and an ever‑changing environment

Qualifications, Skills & Experience

• 3+ years proven ability of professional Data Development experience
• 3+ years proven ability of developing with Databricks
• 3+ years of experience with PySpark/Spark
• 3+ years of experience developing with either Python or Java
• Full understanding of ETL concepts and Data Warehousing concepts
• Experience with Pipeline Orchestration
• Experience with CI/CD
• Experience with version control software
• Strong understanding of Agile Principles (Scrum)
• Demonstrates an understanding of AI concepts and patterns.
• Bachelor’s Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)

Desired Characteristics & Technical Skills

• Experience with Azure
• Experience with Databricks Delta Tables, Delta Lake, Delta Live Tables
• Proficient with Relational Data Modeling
• Experience with CI/CD pipelines
• Experience with Python Library Development
• Experience with FastAPI/Flask service development
• Experience working with AKS/Kubernetes/Helm
• Experience with DevOps / Monitoring & Reliability
• Experience with Structured Streaming (Spark or otherwise)
• Experience with Kafka and/or Azure Event Hub
• Experience with Github SaaS / Github Actions
• Experience with Terraform
• Exposure to BI Tooling (Tableau, Power BI, Cognos, etc.)

Pay Transparency And Benefits

• The stated salary range represents the entire span applicable across all geographic markets from lowest to highest. Actual salary offers will be determined by multiple factors including but not limited to geographic location, relevant experience, knowledge, skills, other job‑related qualifications, and alignment with market data and cost of labor. In addition to salary, this position is also eligible for variable compensation.
• Below is a list of some of the benefits we offer our associates:
• Health: Medical: with competitive plan designs and support for self‑care, wellness and mental health. Dental: with in‑network and out‑of‑network benefit. Vision: with in‑network and out‑of‑network benefit.
• Wealth: 401(k) with Roth option and matching contribution. Health Savings Account with matching contribution (requires participation in qualifying medical plan). AD&D and supplemental insurance options to help ensure additional protection for you.
• Happiness: Paid time off with flexibility to meet your life needs, including 5 weeks of vacation time, 7 health and wellness days, 3 floating holidays, as well as 6 company‑paid holidays per year. Paid leave for maternity, paternity and family care instances.

Pay Range

$98,000—$169,050 USD