Databricks Engineer - Delta Lake, Privacy & Cross-Cloud

LA International; Wembley; On-site; GBP 70,000 - 110,000; Full time

Job summary

LA International is seeking a Databricks Engineer to start within weeks. You will architect Databricks Clean Rooms, configure Unity Catalog sharing, and implement robust privacy controls across clouds. Expect to build notebooks, enforce governance, and collaborate with legal and security teams on data-sharing requirements.

The role requires 2+ years on Databricks, 6+ years in data/platform engineering, and will involve travel to Wembley twice weekly. IR35, on-site in the UK.

Qualifications

• Strong Unity Catalog, Delta Lake, and Delta Sharing experience.
• Solid SQL and Python, plus Terraform or other infrastructure-as-code.
• Understanding of privacy-enhancing techniques and regulations (GDPR, UK GDPR, CCPA, sector rules)
• Experience with IAM, network security, and audit on AWS or Azure

Responsibilities

• Architect and configure Databricks Clean Rooms across clouds and workspaces.
• Set up Unity Catalog metastores, catalogs and sharing for controlled access.
• Build and approve clean room notebooks and queries (SQL, Python) for analytics and ML scoring.
• Apply privacy controls: row filters, column masks, thresholds, pseudonymisation.
• Define onboarding, output approval workflows and revocation processes.
• Configure audit logging, lineage and monitoring for each run.
• Coordinate with legal/privacy/security to translate data-sharing into controls.
• Produce architecture diagrams, runbooks and reference patterns for reuse.

Skills

Unity Catalog

Delta Lake

Delta Sharing

SQL

Python

Terraform

Infrastructure as Code

Privacy regs

IAM & security

AWS / Azure

Tools

Terraform

Job description

LA International is seeking a Databricks Engineer to start within weeks. You will architect Databricks Clean Rooms, configure Unity Catalog sharing, and implement robust privacy controls across clouds. Expect to build notebooks, enforce governance, and collaborate with legal and security teams on data-sharing requirements.

The role requires 2+ years on Databricks, 6+ years in data/platform engineering, and will involve travel to Wembley twice weekly. IR35, on-site in the UK.