Senior Databricks Data Engineer — Lakehouse & AI Pipelines

livefront; United States; On-site; USD 140,000 - 210,000; Full time

Job summary

Livefront is seeking a Senior Databricks Data Engineer to design and build robust data pipelines that power AI-enabled digital products. You will own end-to-end data ingestion, transformation, and governance in multi-cloud environments, partnering with clients and cross-functional teams to translate business goals into scalable data solutions.

You'll bring deep Databricks expertise, experience with Lakehouse architectures, and a product-minded approach to deliver measurable outcomes for clients.

Qualifications

• 7-10 years of data engineering experience with at least 5 years in production Databricks environments.
• Experience delivering end-to-end data pipelines in cloud environments and multi-cloud contexts.
• Strong knowledge of Unity Catalog, Delta Lake, and data governance practices.

Responsibilities

• Design and build production data pipelines using Lakeflow, Autoloader, and Structured Streaming.
• Architect Lakehouse solutions on Databricks with Delta Lake and Unity Catalog.
• Maintain Databricks transformation layers including DLT, PySpark notebooks, and dbt.
• Define data models, APIs and data contracts to power product features.
• Collaborate with product and backend engineers across multi-cloud AWS and Azure.
• Champion data governance and compliance via Unity Catalog in engagements.
• Lead data architecture discussions and client-facing delivery as needed.

Skills

Databricks

Lakeflow

Autoloader

Structured Streaming

DLT pipelines

PySpark

dbt

Unity Catalog

Delta Lake

Feature Store

MLflow

Model Serving

AWS

Azure

Data governance

APIs

Tools

Python

SQL

Spark

Delta Lake

Job description

Livefront is seeking a Senior Databricks Data Engineer to design and build robust data pipelines that power AI-enabled digital products. You will own end-to-end data ingestion, transformation, and governance in multi-cloud environments, partnering with clients and cross-functional teams to translate business goals into scalable data solutions.

You'll bring deep Databricks expertise, experience with Lakehouse architectures, and a product-minded approach to deliver measurable outcomes for clients.