Senior Data Engineer (P707)

84.51 Cincinnati (OH)

On-site

USD 120,000 - 160,000

Full time

14 days+

Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

84.51 in Cincinnati is seeking a Senior Data Engineer to build scalable data pipelines that ingest, transform, store, and share data with data scientists and products. You will work with PySpark/Python, Databricks, Hadoop, Hive, and related tools.

Responsibilities include owning features across the SDLC, designing cloud-based solutions, implementing tests, mentoring juniors, and contributing to project estimation and retrospectives.

Qualifications

4+ years of professional data development experience.
3+ years with Databricks or Hadoop/HDFS.
3+ years with PySpark/Spark.
3+ years with SQL.
3+ years with Python/Java/Scala.
Understanding of ETL and data warehousing concepts.
Experience with CI/CD.
Experience with version control.
Strong knowledge of Agile Principles (Scrum).

Responsibilities

Own features and drive them to completion through SDLC.
Design and develop Databricks and cloud-based solutions.
Implement automated unit and integration tests.
Mentor junior engineers.
Participate in estimation for work and releases.
Collaborate with other engineers to solve complex problems.
Drive improvements in data engineering practices.
Embrace new technologies and a changing environment.

Skills

Databricks

Hadoop/HDFS

PySpark/Spark

SQL

Python/Java/Scala

ETL concepts

CI/CD

Version control

Agile / Scrum

Education

Bachelor's Degree in CS / MIS / Math / Analytics / STEM

Tools

Azure

Delta Lake

Databricks Delta Tables

Kafka

Snowflake

GitHub Actions

Tableau/Power BI

Job description

As a Senior Data Engineer, you will have the opportunity to build solutions that ingest, transform, store, and distribute our big data to be consumed by data scientists and our products.

Our data engineers use PySpark/Python, Databricks, Hadoop, Hive, and other data engineering technologies and visualization tools to deliver data capabilities and services to our scientists, products, and tools.

Responsibilities

Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes internal and external facing applications as well as process improvement activities:

Participate in the design and development of Databricks and Cloud-based solutions.
Implement automated unit and integration testing.
Collaborate with architecture and lead engineers to ensure consistent development practices.
Provide mentoring to junior engineers.
Participate in retrospective reviews.
Participate in the estimation process for new work and releases.
Collaborate with other engineers to solve and bring new perspectives to complex problems.
Drive improvements in data engineering practices, procedures, and ways of working.
Embrace new technologies and an ever-changing environment.

Requirements

4+ years proven ability of professional Data Development experience
3+ years proven ability of developing with Databricks or Hadoop/HDFS
3+ years of experience with PySpark/Spark
3+ years of experience with SQL
3+ years of experience developing with either Python, Java, or Scala
Full understanding of ETL concepts and Data Warehousing concepts
Experience with CI/CD
Experience with version control software
Strong understanding of Agile Principles (Scrum)
Bachelor’s Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)

Bonus Points