Remote Databricks Data Engineer — AI & Lakehouse Architect

Livefront, Inc.; Peru (IL); On-site; USD 90,000 - 140,000; Full time

Job summary

Livefront, Inc. is seeking a senior Databricks Data Engineer to design and operate data pipelines and Lakehouse architectures for client projects. This role emphasizes production Databricks, SQL/Python, and cloud deployments across AWS and Azure, with a remote option in Peru.

The ideal candidate brings 3–5 years of data engineering experience, strong Databricks depth, and a passion for turning data into value for product experiences.

Qualifications

• 3-5 years of data engineering experience with at least 2 years in production Databricks environments.
• Solid working knowledge of AWS and Azure cloud services relevant to Databricks deployments.
• Deep, production‑grade Databricks expertise: Lakeflow Declarative Pipelines, Autoloader, Structured Streaming, Lakeflow Jobs, Unity Catalog.
• Proven experience designing Lakehouse architectures — medallion patterns, Delta Lake table design.
• Hands‑on experience with data pipeline testing, observability, and CI/CD for data.
• Strong proficiency in SQL and Python, with the ability to write clean, performant code.
• Understanding of data modeling, schema design, and query optimization.
• Excellent communication skills with technical and non‑technical stakeholders.
• Strong problem‑solving skills and ability to navigate ambiguous requirements.
• Hold or pursuing a Databricks certification.

Responsibilities

• Design and build production data pipelines with end‑to‑end ownership.
• Architect Lakehouse solutions on Databricks with Delta Lake and Unity Catalog.
• Build and maintain Databricks transformation layers with data quality constraints.
• Design data and AI foundations to power production ML and AI‑enabled products.
• Collaborate with product and backend engineers on data models and APIs.
• Consult with clients to understand data challenges and implement sustainable solutions.
• Lead data architecture discussions or support internal teams as needed.
• Work within multi‑cloud environments (AWS and Azure) with Databricks as the focus.
• Champion data governance with Unity Catalog as a core engagement element.
• Design data‑to‑application architectures linking governed data to AI workflows.
• Help build Livefront's Databricks practice with accelerators and enablement materials.

Skills

Databricks

SQL

Python

Data pipelines

Delta Lake

Unity Catalog

DLT pipelines

MLflow

dbt

Git

Declarative Automation Bundles

Lakeflow Declarative Pipelines

Autoloader

Structured Streaming

Tools

Lakeflow Declarative Pipelines

Autoloader

Structured Streaming

dbt

Git

Job description

Livefront, Inc. is seeking a senior Databricks Data Engineer to design and operate data pipelines and Lakehouse architectures for client projects. This role emphasizes production Databricks, SQL/Python, and cloud deployments across AWS and Azure, with a remote option in Peru.

The ideal candidate brings 3–5 years of data engineering experience, strong Databricks depth, and a passion for turning data into value for product experiences.