Senior Data Engineer — Databricks, PySpark & Azure

84.51°; Chicago (IL); On-site; USD 98,000 - 169,000; Full time

Benefits offered by this job

Health insurance

401(k) with company match

Paid time off

Job summary

84.51°, a retail data science, insights and media company, seeks a Senior Data Engineer to build solutions that ingest, transform, store, and distribute big data for data scientists and products. You will work with PySpark/Python, Databricks, and other data engineering technologies to deliver data capabilities and services.

You will also gain exposure to Python microservice development using FastAPI, Helm, AKS and related technologies, enabling scalable applications across the data platform.

Qualifications

• 3+ years proven ability of professional Data Development experience.

Responsibilities

• Take ownership of features and drive them to completion through all phases of the entire SDLC.
• Participate in design and development of Databricks and Cloud-based solutions.
• Implement automated unit and integration testing.
• Collaborate with architecture and lead engineers to ensure consistent development practices.
• Provide mentoring to junior engineers.
• Participate in retrospective reviews.
• Participate in estimation for new work and releases.
• Collaborate with other engineers to solve complex problems.
• Drive improvements in data engineering practices, procedures, and ways of working.
• Embrace new technologies and an ever-changing environment.

Skills

Databricks

PySpark

Python/Java

ETL concepts

CI/CD

Agile/Scrum

AI concepts

Azure

Education

Bachelor’s Degree in Computer Science / MIS / Mathematics / STEM

Tools

Kubernetes/AKS

FastAPI/Flask

Terraform

Git / Version Control

Job description

84.51°, a retail data science, insights and media company, seeks a Senior Data Engineer to build solutions that ingest, transform, store, and distribute big data for data scientists and products. You will work with PySpark/Python, Databricks, and other data engineering technologies to deliver data capabilities and services.

You will also gain exposure to Python microservice development using FastAPI, Helm, AKS and related technologies, enabling scalable applications across the data platform.