Lead Data Engineer: Azure + Databricks for Personalization

84.51˚; Cincinnati (OH); On-site; USD 125,000 - 207,000; Full time

Benefits offered by this job

Health benefits

401(k) matching

Paid time off

Job summary

84.51° Lead Data Engineer role focusing on designing and implementing solutions to ingest, store, transform, and distribute big data on Azure Cloud. You will work with Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, JSON, and SQL to build tools powering customer personalization for Kroger shoppers.

In this role, you will collaborate with Product and Data Science, mentor engineers, and drive Databricks-based solution development while aligning with Agile planning and enterprise

Qualifications

• Bachelor’s degree in Computer Science, MIS, Mathematics, Business Analytics or another technically strong program.
• 5+ years of professional data development experience.
• Strong understanding of Agile Principles (Scrum).
• 5+ years of experience developing with Spark (Databricks, PySpark).
• Full understanding of ETL concepts and data warehousing concepts.
• 3+ years of experience developing with Python.
• 1+ year of experience developing REST APIs.
• 1+ year of experience with Kubernetes.

Responsibilities

• Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC, including external and internal applications and process improvement activities.
• Develop business domain understanding and translate it to technical stakeholders.
• Set technical strategy in partnership with Data Science, Product, Architecture and Kroger partners.
• Oversee team(s) of engineers, including operations and development, blended offshore/onshore.
• Provide mentoring to junior resources.
• Lead design and development of Databricks‑based solutions.
• Perform development of REST APIs hosted in Kubernetes.
• Execute unit and integration testing.
• Collaborate with senior resources to ensure consistent development practices.
• Bring new perspectives to problems and be driven to improve yourself and the way things are done.

Skills

Spark (Databricks PySpark)

Python programming

REST APIs

Education

Bachelor’s degree in CS MIS Math or BA

Tools

Databricks

Kubernetes

SQL

Job description

84.51° Lead Data Engineer role focusing on designing and implementing solutions to ingest, store, transform, and distribute big data on Azure Cloud. You will work with Databricks (Spark, SQL, PySpark), Databricks Workflows, Python, JSON, and SQL to build tools powering customer personalization for Kroger shoppers.

In this role, you will collaborate with Product and Data Science, mentor engineers, and drive Databricks-based solution development while aligning with Agile planning and enterprise