Senior Databricks Data Engineer — Remote AI Pipelines

Rallyday Partners; Peru (IL); On-site; USD 120,000 - 180,000; Full time

Job summary

Livefront is seeking a Databricks Data Engineer to design and build production data pipelines, Lakehouse architectures, and AI-ready data foundations for client projects. This senior role offers a high‑impact, remote opportunity in Peru, with exposure to multi‑cloud environments (AWS, Azure) and cutting‑edge tools like Lakeflow, Unity Catalog, and MLflow.

You will own end‑to‑end data workflows, collaborate with data scientists and product teams, and contribute to Livefront’s Databricks practice

Qualifications

• 3–5 years of data engineering experience with Databricks in production.
• Deep knowledge of AWS and Azure cloud services for Databricks deployments.
• Production experience with Lakeflow, Autoloader, Delta Lake, Unity Catalog, and MLflow.
• Strong SQL and Python skills; data modeling and query optimization.
• Excellent communication for technical and non‑technical stakeholders.

Responsibilities

• Design and build production data pipelines with end‑to‑end ownership.
• Architect Lakehouse solutions on Databricks tailored for analytics and AI needs.
• Maintain Databricks transformation layers (DLT, PySpark, dbt) with data quality and SLAs.
• Develop data foundations (Unity Catalog, Feature Store, MLflow) powering ML workflows.
• Collaborate with product/backend teams on data models and APIs.
• Consult with clients to understand data challenges and implement sustainable solutions.
• Lead data architecture discussions when needed and support internal teams.
• Operate in multi‑cloud environments (AWS and Azure) with Databricks fit.

Skills

Databricks

Lakehouse

SQL

Python

AWS

Azure

GCP familiarity

CI/CD for data

Data modeling

Communication

Tools

Lakeflow Declarative Pipelines

Autoloader

Delta Lake

Unity Catalog

MLflow

dbt

Structured Streaming

Lakeflow Jobs

Job description

Livefront is seeking a Databricks Data Engineer to design and build production data pipelines, Lakehouse architectures, and AI-ready data foundations for client projects. This senior role offers a high‑impact, remote opportunity in Peru, with exposure to multi‑cloud environments (AWS, Azure) and cutting‑edge tools like Lakeflow, Unity Catalog, and MLflow.

You will own end‑to‑end data workflows, collaborate with data scientists and product teams, and contribute to Livefront’s Databricks practice