Senior Databricks Engineer for AI Lakehouse Platform

Vantiva; Lisboa; Hybrid; EUR 70,000 - 110,000; Full time

Job summary

Vantiva is seeking a senior data/platform engineer to build and operate a secure, scalable Databricks Lakehouse foundation. You will enable AI workflows, MLOps patterns, and data pipelines to support Generative AI solutions across business units.

The role requires strong Python/SQL skills, expertise in Unity Catalog governance, and experience with Delta Lake and Spark in Azure Databricks environments.

Qualifications

• 5+ years in data engineering or platform engineering roles.
• 3+ years hands-on experience with Azure Databricks (workspace administration, Delta Lake, Spark, Unity Catalog).
• Strong proficiency in Python and SQL.

Responsibilities

• AI Application Enablement: support AI-powered applications, including LLM/GenAI workflows and RAG pipelines.
• Data Platform Foundation: design, build, and maintain the Databricks Lakehouse platform with security and governance.
• Data Engineering: develop production-grade data pipelines delivering clean, reliable datasets for analytics and AI workloads.
• Solution Architecture: produce reference architectures and patterns for data ingestion, transformation, storage, and consumption.

Skills

Python

SQL

Azure Databricks

Data pipelines

GenAI integration

RBAC

Unity Catalog

Delta Lake

Security

Tools

Databricks

Spark

Unity Catalog

Delta Lake

Job description

Vantiva is seeking a senior data/platform engineer to build and operate a secure, scalable Databricks Lakehouse foundation. You will enable AI workflows, MLOps patterns, and data pipelines to support Generative AI solutions across business units.

The role requires strong Python/SQL skills, expertise in Unity Catalog governance, and experience with Delta Lake and Spark in Azure Databricks environments.