Senior Data Engineer – Databricks, PySpark & CI/CD

84.51°; Chicago (IL); On-site; USD 121,000 - 169,000; Full time

Benefits offered by this job

Health insurance

401(k) with Roth option

HSA matching

Paid time off

Company holidays

Job summary

84.51° is seeking an experienced Data Engineer to own features across the full SDLC, focusing on Databricks and cloud-based data solutions. You will implement tests, mentor juniors, and collaborate with data scientists and product partners to deliver scalable pipelines.

Join a cross-functional team that values data quality, governance, and agile development. The role is based in Chicago with a strong in-office collaboration culture and competitive compensation.

Qualifications

• Bachelor’s degree in Computer Science, MIS, Math, Business Analytics or STEM.
• 3+ years of professional data development experience.
• 3+ years of Databricks experience.
• 3+ years of PySpark/Spark experience.
• 3+ years of Python or Java development.
• Solid understanding of ETL and Data Warehousing concepts.
• Experience with Pipeline Orchestration.
• Experience with CI/CD and version control.
• Strong Agile/Scrum principles knowledge.
• Experience preparing data for downstream consumers with data quality governance and metadata documentation.

Responsibilities

• Take ownership of features and drive them through all SDLC phases.
• Design and develop Databricks and cloud-based solutions.
• Implement automated unit and integration tests.
• Collaborate with architects and senior engineers to standardize practices.
• Mentor junior engineers.
• Work with data scientists, product partners, and engineers to build reliable data pipelines.
• Participate in retrospectives and release planning.
• Contribute to data engineering best practices and governance.

Skills

Databricks

PySpark

Python

Java

ETL concepts

Data warehousing

Pipeline orchestration

CI/CD

Version control

Agile/Scrum

Data quality governance

Education

Bachelor’s Degree in CS/MIS/Math/Analytics/STEM

Tools

Azure

Databricks Delta Tables

Kubernetes

GitHub Actions

Job description

84.51° is seeking an experienced Data Engineer to own features across the full SDLC, focusing on Databricks and cloud-based data solutions. You will implement tests, mentor juniors, and collaborate with data scientists and product partners to deliver scalable pipelines.

Join a cross-functional team that values data quality, governance, and agile development. The role is based in Chicago with a strong in-office collaboration culture and competitive compensation.