Lead Data Engineer — Azure & Databricks

84.51˚; Chicago (IL); On-site; USD 125,000 - 207,000; Full time

Benefits offered by this job

Medical plan

401(k) with Roth

Paid time off

Job summary

84.51°, a Kroger subsidiary, is seeking a Lead Data Engineer in Chicago to design and implement big data solutions on Azure Cloud. You will lead features from inception through deployment, coordinating with Product, Data Science, and Architecture to deliver scalable data platforms.

The role focuses on Databricks (Spark, PySpark), Python, SQL, and REST APIs hosted in Kubernetes, with a strong emphasis on ETL, data warehousing, and collaboration to optimize customer personalization and insights

Qualifications

• Bachelor’s degree in Computer Science, MIS, Mathematics, Business Analytics or another technically strong program.
• 5+ years of professional data development experience.
• Strong understanding of Agile Principles (Scrum).
• 5+ years of experience developing with Spark (Databricks, PySpark).
• Full understanding of ETL concepts and data warehousing concepts.
• 3+ years of experience developing with Python.
• 1+ year of experience developing REST APIs.
• 1+ year of experience with Kubernetes.

Responsibilities

• Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC, including external and internal applications and process improvement activities.
• Develop business domain understanding and translate it to technical stakeholders.
• Set technical strategy in partnership with Data Science, Product, Architecture and Kroger partners.
• Oversee team(s) of engineers, including operations and development, blended offshore/onshore.
• Provide mentoring to junior resources.
• Lead design and development of Databricks‑based solutions.
• Perform development of REST APIs hosted in Kubernetes.
• Execute unit and integration testing.
• Collaborate with senior resources to ensure consistent development practices.
• Bring new perspectives to problems and be driven to improve yourself and the way things are done.

Skills

Agile Principles

Spark (Databricks)

Python

REST APIs

Kubernetes

Education

Bachelor’s degree in Computer Science, MIS, Mathematics, Business Analytics or similar

Tools

Databricks

Azure Cloud

Job description

84.51°, a Kroger subsidiary, is seeking a Lead Data Engineer in Chicago to design and implement big data solutions on Azure Cloud. You will lead features from inception through deployment, coordinating with Product, Data Science, and Architecture to deliver scalable data platforms.

The role focuses on Databricks (Spark, PySpark), Python, SQL, and REST APIs hosted in Kubernetes, with a strong emphasis on ETL, data warehousing, and collaboration to optimize customer personalization and insights