Senior Databricks Data Engineer for AI & Lakehouse

OpenKrill; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

Livefront is seeking a Senior Databricks Data Engineer to join our growing data practice and build the data and AI foundations that power our clients’ digital products. You will design and implement Lakehouse architectures on Databricks, manage end-to-end pipelines, ensure data quality, and collaborate with data scientists, product and engineering teams to enable AI-driven experiences across AWS and Azure.

If you thrive in consulting, translate complex data challenges into concrete requirements,

Qualifications

• 7-10 years of data engineering, 5+ in production Databricks environments.
• Strong AWS and Azure cloud knowledge; GCP familiarity a plus.
• Deep Databricks expertise with Lakeflow, Autoloader and Structured Streaming.
• Proven Lakehouse architecture design: Delta Lake, partitioning, optimization.
• CI/CD, data testing, observability, and versioned deployments.

Responsibilities

• Design and build production data pipelines using Lakeflow and Autoloader with end-to-end ownership.
• Architect Lakehouse solutions on Databricks tailored to analytics, AI, and apps.
• Build and maintain Databricks layers with DLT, PySpark, and dbt.
• Shape data foundations: Unity Catalog, Feature Store, MLflow, Model Serving.
• Collaborate with product and backend engineers on data models and contracts.
• Consult with clients to understand data challenges and develop sustainable strategies.
• Lead or support data architecture discussions and multi-cloud deployments (AWS/Azure).
• Champion data governance and quality across engagements.

Skills

Databricks expert

SQL

Python

CI/CD

Data modeling

Cloud AWS/Azure

Communication

Problem solving

Team collaboration

Production experience

Tools

Lakeflow Declarative Pipelines

Autoloader

Structured Streaming

Delta Lake

Unity Catalog

MLflow

Model Serving

dbt

Job description

Livefront is seeking a Senior Databricks Data Engineer to join our growing data practice and build the data and AI foundations that power our clients’ digital products. You will design and implement Lakehouse architectures on Databricks, manage end-to-end pipelines, ensure data quality, and collaborate with data scientists, product and engineering teams to enable AI-driven experiences across AWS and Azure.

If you thrive in consulting, translate complex data challenges into concrete requirements,