Senior Data Engineer: Databricks & Data Platform Lead

84.51

Cincinnati (OH)

On-site

USD 120,000 - 160,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job description

As a Senior Data Engineer, you will have the opportunity to build solutions that ingest, transform, store, and distribute our big data to be consumed by data scientists and our products.

Our data engineers use PySpark/Python, Databricks, Hadoop, Hive, and other data engineering technologies and visualization tools to deliver data capabilities and services to our scientists, products, and tools.

Responsibilities

Take ownership of features and drive them to completion through all phases of the entire 84.51° SDLC. This includes internal and external facing applications as well as process improvement activities:

  • Participate in the design and development of Databricks and Cloud-based solutions.
  • Implement automated unit and integration testing.
  • Collaborate with architecture and lead engineers to ensure consistent development practices.
  • Provide mentoring to junior engineers.
  • Participate in retrospective reviews.
  • Participate in the estimation process for new work and releases.
  • Collaborate with other engineers to solve and bring new perspectives to complex problems.
  • Drive improvements in data engineering practices, procedures, and ways of working.
  • Embrace new technologies and an ever-changing environment.

Requirements

  • 4+ years proven ability of professional Data Development experience
  • 3+ years proven ability of developing with Databricks or Hadoop/HDFS
  • 3+ years of experience with PySpark/Spark
  • 3+ years of experience with SQL
  • 3+ years of experience developing with either Python, Java, or Scala
  • Full understanding of ETL concepts and Data Warehousing concepts
  • Experience with CI/CD
  • Experience with version control software
  • Strong understanding of Agile Principles (Scrum)
  • Bachelor’s Degree (Computer Science, Management Information Systems, Mathematics, Business Analytics, or STEM)

Bonus Points

  • Experience with Azure
  • Experience with Databricks Delta Tables, Delta Lake, Delta Live Tables
  • Proficient with Relational Data Modeling
  • Experience with Python Library Development
  • Experience with Structured Streaming (Spark or otherwise)
  • Experience with Kafka and/or Azure Event Hub
  • Experience with GitHub SaaS / GitHub Actions
  • Experience with Snowflake
  • Exposure to BI Tooling (Tableau, Power BI, Cognos, etc.)
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

UNAVAILABLE • McLean (VA)

On-site
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

Veriipro • Atlanta (GA)

On-site
USD 140,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Bitful • United States

Remote
USD 120,000 - 180,000
Senior Databricks Engineer
Senior Databricks Engineer

Remote • San Francisco (CA)

On-site
USD 150,000 - 190,000
Senior Data Engineer
Senior Data Engineer

Bitful Inc. • Wadsworth (OH)

On-site
USD 110,000 - 160,000
Data Engineer
Data Engineer

GSquared Group • Atlanta (GA)

On-site
USD 120,000 - 160,000
Databricks Developer
Databricks Developer

Vservice It Solutions • United States

Remote
USD 140,000 - 190,000
Senior Databricks Data Engineer
Senior Databricks Data Engineer

Virtue America • New York (NY)

On-site
USD 140,000 - 190,000
Senior Consultant (Databricks)
Senior Consultant (Databricks)

Unison Group • San Francisco (CA)

On-site
USD 180,000 - 250,000
Lead Databricks Data Engineer
Lead Databricks Data Engineer

Fa Ewjt Saasfaprod1 • New York (NY)

On-site
USD 140,000 - 170,000