Senior Databricks Engineer: Spark, Delta Lake Pipelines

Quantum Technologies. LLC

Louisville (KY)

On-site

USD 140,000 - 180,000

Full time

4 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Quantum Technologies. LLC in Louisville, KY is seeking an experienced Databricks Developer to design, develop and optimize scalable data processing solutions on the Databricks Lakehouse Platform.

The ideal candidate will bring strong expertise in Spark, PySpark, Spark SQL, and Delta Lake, along with a proven track record building enterprise-grade data pipelines. You will collaborate with Data Architects, Scientists, and Analysts to support data modernization, governance, and analytics

Qualifications

  • Bachelor's degree in CS, IS, engineering, or related field.
  • 8+ years hands-on Databricks development experience.
  • Strong expertise in Apache Spark, PySpark, Spark SQL, and Delta Lake.

Responsibilities

  • Design, develop, and optimize scalable data processing pipelines in Databricks.
  • Build robust data processing solutions with PySpark, Spark SQL, and Delta Lake.
  • Implement data validation, data quality checks, and performance tuning.
  • Design and manage data architecture within the Databricks Lakehouse Platform.
  • Ensure data reliability, governance, and security; collaborate with analytics teams.

Skills

Databricks
Spark
PySpark
Spark SQL
Delta Lake
Data pipelines
Performance tuning
Data governance
Agile
Cross-functional collaboration

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field

Tools

Databricks
Apache Spark
PySpark
Spark SQL
Delta Lake

Job description

Quantum Technologies. LLC in Louisville, KY is seeking an experienced Databricks Developer to design, develop and optimize scalable data processing solutions on the Databricks Lakehouse Platform.

The ideal candidate will bring strong expertise in Spark, PySpark, Spark SQL, and Delta Lake, along with a proven track record building enterprise-grade data pipelines. You will collaborate with Data Architects, Scientists, and Analysts to support data modernization, governance, and analytics

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Databricks Engineer: Spark, Delta Lake & Pipelines
Senior Databricks Engineer: Spark, Delta Lake & Pipelines

Ethereum Technologies • Louisville (KY)

On-site
USD 140,000 - 190,000
Senior Databricks Architect - AWS Lakehouse & Streaming
Senior Databricks Architect - AWS Lakehouse & Streaming

Quantum Technologies. LLC • Columbus (OH)

On-site
USD 120,000 - 180,000
Senior Databricks Engineer: Spark, Delta Lake & Lakehouse
Senior Databricks Engineer: Spark, Delta Lake & Lakehouse

Valiant Technologies LLC • Louisville (KY)

On-site
USD 140,000 - 190,000
Databricks Engineer - Lakehouse Data Pipelines & Spark
Databricks Engineer - Lakehouse Data Pipelines & Spark

Quantum Technologies LLC • Austin (TX)

On-site
USD 120,000 - 190,000
Data Engineer: Spark, Databricks & Lakehouse Architect
Data Engineer: Spark, Databricks & Lakehouse Architect

Quantum Technologies LLC • Houston (TX)

On-site
USD 110,000 - 170,000
Senior Databricks Engineer – Data Platform Mastery
Senior Databricks Engineer – Data Platform Mastery

Quantum Technologies LLC • Pennsylvania

On-site
USD 96,000 - 131,000
Senior Databricks Engineer – Lakehouse Pipelines & Spark
Senior Databricks Engineer – Lakehouse Pipelines & Spark

Valiant Technologies LLC • Austin (TX)

On-site
USD 130,000 - 190,000
Senior Databricks Data Engineer: Scale Big Data Pipelines
Senior Databricks Data Engineer: Scale Big Data Pipelines

Quantum Technologies. LLC • Dallas (TX)

On-site
USD 150,000 - 190,000
Senior Databricks Data Engineer — ETL/ELT Pipelines
Senior Databricks Data Engineer — ETL/ELT Pipelines

Quantum Technologies. LLC • Madison (WI)

On-site
USD 110,000 - 140,000
Azure Databricks Data Engineer — Lakehouse & Spark Expert
Azure Databricks Data Engineer — Lakehouse & Spark Expert

Quantum Technologies LLC • Dallas (TX)

On-site
USD 120,000 - 180,000