Senior Data Engineer (P4025, P4026*)

84.51 Deerfield (IL)

Hybrid

USD 100,000 - 130,000

Full time

14 days+

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

84.51 is looking for a Senior Data Engineer to build solutions that manage big data for data scientists and products. The role demands a hybrid work model, requiring presence in the office three days a week. Ideal candidates should have over 4 years of experience in Data Development and strong skills in Databricks, Hadoop, and PySpark.

Key responsibilities include developing cloud solutions, mentoring juniors, and driving improvements in data practices. A Bachelor’s degree in a relevant field is required.

Qualifications

4+ years of professional Data Development experience.
3+ years developing with Databricks or Hadoop/HDFS.
3+ years of experience with PySpark/Spark.
3+ years of experience with SQL.
3+ years experience developing with Python, Java, or Scala.

Responsibilities

Take ownership of features and drive them through all phases.
Participate in the design of Databricks and Cloud-based solutions.
Implement automated unit and integration testing.
Provide mentoring to junior engineers.
Drive improvements in data engineering practices.

Skills

Data Development

Databricks

Hadoop/HDFS

PySpark/Spark

SQL

Python

Java

Scala

Agile Principles

Education

Bachelor’s Degree in Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM

Tools

Azure

GitHub

Snowflake

BI Tooling (Tableau, Power BI, Cognos)

Job description

As a Senior Data Engineer, you will have the opportunity to build solutions that ingest, transform, store, and distribute our big data to be consumed by data scientists and our products.

Our data engineers use PySpark/Python, Databricks, Hadoop, Hive, and other data engineering technologies and visualization tools to deliver data capabilities and services to our scientists, products, and tools.

84.51 has a hybrid work schedule where employees come into the office 3 days per week, Monday through Wednesday. Candidates must live in either Cincinnati, OH or Chicago, IL for this position.

Responsibilities

Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes internal and external facing applications as well as process improvement activities.
Participate in the design and development of Databricks and Cloud-based solutions.
Implement automated unit and integration testing.
Collaborate with architecture and lead engineers to ensure consistent development practices.
Provide mentoring to junior engineers.
Participate in retrospective reviews.
Participate in the estimation process for new work and releases.
Collaborate with other engineers to solve and bring new perspectives to complex problems.
Drive improvements in data engineering practices, procedures, and ways of working.
Embrace new technologies and an ever-changing environment.

Requirements

4+ years proven ability of professional Data Development experience
3+ years proven ability of developing with Databricks or Hadoop/HDFS
3+ years of experience with PySpark/Spark
3+ years of experience with SQL
3+ years of experience developing with either Python, Java, or Scala
Full understanding of ETL concepts and Data Warehousing concepts
Experience with CI/CD
Experience with version control software
Strong understanding of Agile Principles (Scrum)
Bachelor’s Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)

Bonus Points for experience in the following