Senior Databricks Data Engineer — Lakehouse & AI Pipelines

Livefront; Northern (KY); Hybrid; USD 150,000 - 180,000; Full time

Job summary

Livefront seeks a Senior Databricks Data Engineer to design and build production pipelines and Lakehouse architectures. You’ll own ingestion, transformation, and data quality across multi-cloud environments, delivering scalable data foundations for analytics and AI applications.

You will collaborate with data scientists and engineers, implement CI/CD for data, and advance Databricks capabilities through certifications and accelerators.

Qualifications

• Proven Databricks production experience across analytics and AI workloads.
• Experience designing Lakehouse architectures and medallion patterns.
• Strong SQL and Python with clean, maintainable code.
• Knowledge of CI/CD for data and data quality testing.

Responsibilities

• Design and build production data pipelines using Lakeflow Declarative Pipelines, Autoloader, and Structured Streaming with end-to-end ownership.
• Architect and implement Lakehouse solutions on Databricks tailored to analytics and AI needs.
• Build and maintain Databricks transformation layers (DLT pipelines, PySpark notebooks, dbt) with data quality and SLAs.
• Design and maintain data and AI foundations (Unity Catalog, Feature Store, MLflow, Model Serving).
• Collaborate with product and backend engineers to design data models, APIs, and contracts.

Skills

Databricks

SQL

Python

Delta Lake

Structured Streaming

CI/CD for data

AWS/Azure cloud

DLT pipelines

Model Serving

Communication

Education

Bachelor's degree in CS or related field

Databricks certification

Tools

Lakeflow Declarative Pipelines

Autoloader

Structured Streaming

dbt

MLflow

Unity Catalog

Delta Lake

Job description

Livefront seeks a Senior Databricks Data Engineer to design and build production pipelines and Lakehouse architectures. You’ll own ingestion, transformation, and data quality across multi-cloud environments, delivering scalable data foundations for analytics and AI applications.

You will collaborate with data scientists and engineers, implement CI/CD for data, and advance Databricks capabilities through certifications and accelerators.