Senior Databricks Engineer: Spark, Delta Lake & Pipelines

Ethereum Technologies

Louisville (KY)

On-site

USD 140,000 - 190,000

Full time

Just now
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Ethereum Technologies in Louisville, Kentucky seeks an experienced Databricks Developer to design, build, and optimize scalable data pipelines on the Databricks Lakehouse Platform, leveraging Spark, PySpark, Spark SQL and Delta Lake.

You will implement data quality checks, governance, and performance tuning, collaborate with data architects, data scientists, and business analysts, participate in Agile ceremonies, and help drive enterprise data modernization and analytics initiatives.

Qualifications

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field.
  • 8+ years hands-on Databricks development experience.
  • Strong expertise in Apache Spark and the Databricks Lakehouse Platform.
  • Hands-on experience developing data pipelines using PySpark and Spark SQL.
  • Experience with Delta Lake and its capabilities.

Responsibilities

  • Design, develop, and maintain scalable batch and real-time data pipelines using Databricks.
  • Build robust data processing solutions using PySpark, Spark SQL, and Delta Lake.
  • Implement data validation, data quality checks, and performance-tuning strategies.
  • Design and manage data architecture within the Databricks Lakehouse Platform.
  • Develop data models to support analytics and reporting requirements.
  • Ensure data reliability, scalability, and governance.

Skills

Databricks
Apache Spark
PySpark
Spark SQL
Delta Lake
Performance tuning
Data modeling
Data governance

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field

Tools

Delta Lake

Job description

Ethereum Technologies in Louisville, Kentucky seeks an experienced Databricks Developer to design, build, and optimize scalable data pipelines on the Databricks Lakehouse Platform, leveraging Spark, PySpark, Spark SQL and Delta Lake.

You will implement data quality checks, governance, and performance tuning, collaborate with data architects, data scientists, and business analysts, participate in Agile ceremonies, and help drive enterprise data modernization and analytics initiatives.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Databricks Engineer: Spark, Delta Lake Pipelines
Senior Databricks Engineer: Spark, Delta Lake Pipelines

Quantum Technologies. LLC • Louisville (KY)

On-site
USD 140,000 - 180,000
Senior Databricks Engineer: Spark, Delta Lake & Lakehouse
Senior Databricks Engineer: Spark, Delta Lake & Lakehouse

Valiant Technologies LLC • Louisville (KY)

On-site
USD 140,000 - 190,000
Databricks Data Engineer: Spark & Delta Lake Pipelines
Databricks Data Engineer: Spark & Delta Lake Pipelines

Ethereum Technologies • Madison (WI)

On-site
USD 110,000 - 160,000
Senior Databricks Engineer – Lakehouse Pipelines & Spark
Senior Databricks Engineer – Lakehouse Pipelines & Spark

Valiant Technologies LLC • Austin (TX)

On-site
USD 130,000 - 190,000
Senior Databricks Lakehouse Engineer
Senior Databricks Lakehouse Engineer

Ethereum Technologies LLC • Austin (TX)

On-site
USD 130,000 - 185,000
Senior Data Engineer - Databricks Lakehouse & AWS
Senior Data Engineer - Databricks Lakehouse & AWS

Ethereum Technologies • Tampa (FL)

On-site
USD 91,000 - 124,000
Senior Databricks Developer - Lakehouse & Spark Expert
Senior Databricks Developer - Lakehouse & Spark Expert

Robotic Technologies Automation • Louisville (KY)

On-site
USD 110,000 - 170,000
Azure Databricks Data Engineer - Lakehouse & Pipelines
Azure Databricks Data Engineer - Lakehouse & Pipelines

Ethereum Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 160,000
Senior Databricks Lakehouse Architect (PySpark/ETL)
Senior Databricks Lakehouse Architect (PySpark/ETL)

VService IT Solutions • United States

Remote
USD 140,000 - 190,000
Senior Databricks Engineer – Remote Data Pipelines
Senior Databricks Engineer – Remote Data Pipelines

Princeton IT Services, Inc • United States

Remote
USD 130,000 - 180,000