Lead Data Engineer

84.51˚; Chicago (IL); On-site; USD 125,000 - 207,000; Full time

Benefits offered by this job

Health insurance

401(k) with Roth option and matching

Paid time off and holidays

Job summary

84.51° Lead Data Engineer designs and implements ingestion, storage, transformation, and distribution of big data on Azure Cloud. Use Databricks, Spark, PySpark, Python, JSON, and SQL to power customer personalization at scale.

Strong collaboration with Product and Data Science is essential for success. Take ownership of features, mentor engineers, and lead Databricks-based solution development while guiding REST API work hosted in Kubernetes is expected.

Qualifications

• Bachelor’s degree in CS or related field.
• 5+ years data development experience.
• 5+ years Spark (Databricks, PySpark) experience.
• 3+ years Python experience.
• 1+ year REST API development.
• 1+ year Kubernetes experience.

Responsibilities

• Own features across the SDLC for Databricks-based solutions.
• Lead design and development of Databricks-based solutions.
• Develop REST APIs hosted in Kubernetes.
• Mentor junior engineers and engineers across teams.
• Collaborate with Product and Data Science teams.
• Set technical strategy with Data Science and Product partners.
• Oversee teams including Offshore/Onshore resources.
• Drive continuous improvement in development practices.

Skills

Spark (Databricks/PySpark)

Python

REST APIs

Kubernetes

Agile SCRUM

ETL concepts

Education

Bachelor’s degree in Computer Science or related field

Tools

Databricks

SQL

Kubernetes

Job description

84.51° Overview

84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.

84.51° Overview

84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase. Powered by cutting‑edge science, we utilize first‑party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer‑centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.

84.51° follows a 5‑day in‑office work schedule to support collaboration, alignment, and team connection. Join us at 84.51°!

__________________________________________________________

PLEASE NOTE:Applicants for employment in the US must have work authorization that does not now or in the future require sponsorship of a visa for employment authorization in the United Stated and with the Kroger Family of Companies (i.e. H1-B visa, F-1 visa (OPT), TN visa or any other non-immigrant status).

LEAD DATA ENGINEER

Summary

As a Lead Data Engineer, you will design and implement solutions to ingest, store, transform, and distribute big data on Azure Cloud. Our developers use Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, JSON, and SQL to build products, tools, and features that power customer personalization at scale. Communication and Collaboration with Product and Data science are critical to success and are expected for this role to be successful.

Responsibilities

Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes external facing and internal applications as well as process improvement activities such as:

• Develop Business Domain understanding, bridges this to technical stakeholders
• Sets technical strategy in partnership with Data Science, Product, Architecture, and Kroger partners
• Oversees team(s) of Engineers including operations and development, blended Offshore/Onshore
• Provide mentoring to junior resources
• Lead design and development of Databricks-based solutions
• Perform development of REST APIs hosted in Kubernetes
• Execute unit and integration testing
• Collaborate with senior resources to ensure consistent development practices
• Bring new perspectives to problems and be driven to improve yourself and the way things are done

Qualifications, Skills, And Experience

• Bachelor’s degree typically in Computer Science, Management Information Systems, Mathematics, Business Analytics or another technically strong program.
• 5+ years proven ability of professional data development experience
• Strong understanding of Agile Principles (Scrum)
• 5+ years proven ability of developing with Spark (Databricks, PySpark)
• Full understanding of ETL concepts and data warehousing concepts
• 3+ year developing experience with Python
• 1+ year developing experience with REST APIs
• 1+ year experience with Kubernetes

Pay Transparency And Benefits

• The stated salary range represents the entire span applicable across all geographic markets from lowest to highest. Actual salary offers will be determined by multiple factors including but not limited to geographic location, relevant experience, knowledge, skills, other job‑related qualifications, and alignment with market data and cost of labor. In addition to salary, this position is also eligible for variable compensation.
• Below is a list of some of the benefits we offer our associates:
  • Health: Medical: with competitive plan designs and support for self‑care, wellness and mental health. Dental: with in‑network and out‑of‑network benefit. Vision: with in‑network and out‑of‑network benefit.
  • Wealth: 401(k) with Roth option and matching contribution. Health Savings Account with matching contribution (requires participation in qualifying medical plan). AD&D and supplemental insurance options to help ensure additional protection for you.
  • Happiness: Paid time off with flexibility to meet your life needs, including 5 weeks of vacation time, 7 health and wellness days, 3 floating holidays, as well as 6 company‑paid holidays per year. Paid leave for maternity, paternity and family care instances.

Base Pay Range $125,000—$207,000 USD