Databricks Data Engineer: Lakehouse & AI Pipelines

Livefront, Inc.; United States; On-site; USD 120,000 - 145,000; Full time

Job summary

Livefront is seeking a Databricks Data Engineer to design and build production data pipelines across AWS and Azure, implementing Lakeflow Declarative Pipelines, Autoloader, and Delta Lake concepts. You will architect Lakehouse solutions, ensure data quality, and empower AI workflows with MLflow and dbt.

You will collaborate with data scientists, product teams, and executives to translate business needs into scalable data architectures and governance practices that power digital products and

Qualifications

• Experience building production data pipelines in Databricks environments.
• Strong SQL and Python skills with data modeling experience.
• Knowledge of multi-cloud (AWS/Azure) and data governance concepts.
• Ability to translate complex data problems to technical requirements.
• Experience with ML workflows and MLOps on Databricks is a plus.

Responsibilities

• Design and build production data pipelines using Lakeflow Declarative Pipelines and Databricks.
• Architect Lakehouse solutions with Delta Lake, Unity Catalog, and MLflow.
• Develop DBT models and ensure data quality with CI/CD deployments.
• Collaborate with product and backend teams to define data contracts.

Skills

Databricks

SQL

Python

Cloud Platforms

Communication

Problem Solving

Data Modeling

MLOps/LLMOps

Education

Bachelor's degree in CS/Engineering

Tools

Lakeflow

Autoloader

Delta Lake

Unity Catalog

MLflow

dbt

Git

Declarative Bundles

Job description

Livefront is seeking a Databricks Data Engineer to design and build production data pipelines across AWS and Azure, implementing Lakeflow Declarative Pipelines, Autoloader, and Delta Lake concepts. You will architect Lakehouse solutions, ensure data quality, and empower AI workflows with MLflow and dbt.

You will collaborate with data scientists, product teams, and executives to translate business needs into scalable data architectures and governance practices that power digital products and